Apr 11 23:00:17 user nova-compute[71516]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 11 23:00:19 user nova-compute[71516]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71516) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 23:00:19 user nova-compute[71516]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71516) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 23:00:19 user nova-compute[71516]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71516) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 23:00:19 user nova-compute[71516]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.031s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:00:20 user nova-compute[71516]: INFO nova.virt.driver [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 11 23:00:20 user nova-compute[71516]: INFO nova.compute.provider_config [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] Acquiring lock "singleton_lock" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] Acquired lock "singleton_lock" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] Releasing lock "singleton_lock" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] Full set of CONF: {{(pid=71516) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ******************************************************************************** {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] Configuration options gathered from: {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ================================================================================ {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] allow_resize_to_same_host      = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] arq_binding_timeout            = 300 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] backdoor_port                  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] backdoor_socket                = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] block_device_allocate_retries  = 300 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] block_device_allocate_retries_interval = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cert                           = self.pem {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute_monitors               = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] config_dir                     = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] config_drive_format            = iso9660 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] config_source                  = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] console_host                   = user {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] control_exchange               = nova {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cpu_allocation_ratio           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] daemon                         = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] debug                          = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] default_access_ip_network_name = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] default_availability_zone      = nova {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] default_ephemeral_format       = ext4 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] default_schedule_zone          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] disk_allocation_ratio          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] enable_new_services            = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] enabled_ssl_apis               = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] flat_injected                  = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] force_config_drive             = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] force_raw_images               = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] graceful_shutdown_timeout      = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] heal_instance_info_cache_interval = 60 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] host                           = user {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] instance_build_timeout         = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] instance_delete_interval       = 300 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] instance_name_template         = instance-%08x {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] instance_usage_audit           = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] instance_usage_audit_period    = month {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] internal_service_availability_zone = internal {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] key                            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] live_migration_retry_count     = 30 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] log_config_append              = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] log_dir                        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] log_file                       = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] log_options                    = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] log_rotate_interval            = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] log_rotate_interval_type       = days {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] log_rotation_type              = none {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] long_rpc_timeout               = 1800 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] max_concurrent_builds          = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] max_concurrent_live_migrations = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] max_concurrent_snapshots       = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] max_local_block_devices        = 3 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] max_logfile_count              = 30 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] max_logfile_size_mb            = 200 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] maximum_instance_delete_attempts = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] metadata_listen                = 0.0.0.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] metadata_listen_port           = 8775 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] metadata_workers               = 3 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] migrate_max_retries            = -1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] mkisofs_cmd                    = genisoimage {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] my_ip                          = 10.0.0.210 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] network_allocate_retries       = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] osapi_compute_listen_port      = 8774 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] osapi_compute_unique_server_name_scope =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] osapi_compute_workers          = 3 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] password_length                = 12 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] periodic_enable                = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] periodic_fuzzy_delay           = 60 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] pointer_model                  = ps2mouse {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] preallocate_images             = none {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] publish_errors                 = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] pybasedir                      = /opt/stack/nova {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ram_allocation_ratio           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] rate_limit_burst               = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] rate_limit_except_level        = CRITICAL {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] rate_limit_interval            = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] reboot_timeout                 = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] reclaim_instance_interval      = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] record                         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] reimage_timeout_per_gb         = 20 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] report_interval                = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] rescue_timeout                 = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] reserved_host_cpus             = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] reserved_host_disk_mb          = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] reserved_host_memory_mb        = 512 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] reserved_huge_pages            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] resize_confirm_window          = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] resize_fs_using_block_device   = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] resume_guests_state_on_host_boot = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] rpc_response_timeout           = 60 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] run_external_periodic_tasks    = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] running_deleted_instance_action = reap {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] running_deleted_instance_timeout = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] scheduler_instance_sync_interval = 120 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] service_down_time              = 60 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] servicegroup_driver            = db {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] shelved_offload_time           = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] shelved_poll_interval          = 3600 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] shutdown_timeout               = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] source_is_ipv6                 = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ssl_only                       = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] state_path                     = /opt/stack/data/nova {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] sync_power_state_interval      = 600 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] sync_power_state_pool_size     = 1000 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] syslog_log_facility            = LOG_USER {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] tempdir                        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] timeout_nbd                    = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] transport_url                  = **** {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] update_resources_interval      = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] use_cow_images                 = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] use_eventlog                   = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] use_journal                    = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] use_json                       = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] use_rootwrap_daemon            = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] use_stderr                     = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] use_syslog                     = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vcpu_pin_set                   = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plugging_is_fatal          = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plugging_timeout           = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] virt_mkfs                      = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] volume_usage_poll_interval     = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] watch_log_file                 = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] web                            = /usr/share/spice-html5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_concurrency.disable_process_locking = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.auth_strategy              = keystone {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.compute_link_prefix        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.dhcp_domain                = novalocal {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.enable_instance_password   = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.glance_link_prefix         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.instance_list_per_project_cells = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.list_records_by_skipping_down_cells = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.local_metadata_per_cell    = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.max_limit                  = 1000 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.metadata_cache_expiration  = 15 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.neutron_default_tenant_id  = default {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.use_forwarded_for          = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.use_neutron_default_nets   = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.vendordata_dynamic_targets = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.vendordata_jsonfile_path   = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.backend_argument         = **** {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.config_prefix            = cache.oslo {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.dead_timeout             = 60.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.debug_cache_backend      = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.enable_retry_client      = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.enable_socket_keepalive  = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.enabled                  = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.expiration_time          = 600 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.hashclient_retry_attempts = 2 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.memcache_dead_retry      = 300 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.memcache_password        =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.memcache_sasl_enabled    = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.memcache_username        =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.proxies                  = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.retry_attempts           = 2 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.retry_delay              = 0.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.socket_keepalive_count   = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.socket_keepalive_idle    = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.socket_keepalive_interval = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.tls_allowed_ciphers      = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.tls_cafile               = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.tls_certfile             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.tls_enabled              = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cache.tls_keyfile              = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.auth_section            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.auth_type               = password {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.cafile                  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.certfile                = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.collect_timing          = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.cross_az_attach         = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.debug                   = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.endpoint_template       = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.http_retries            = 3 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.insecure                = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.keyfile                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.os_region_name          = RegionOne {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.split_loggers           = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cinder.timeout                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute.cpu_dedicated_set      = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute.cpu_shared_set         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute.image_type_exclude_list = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute.resource_provider_association_refresh = 300 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute.shutdown_retry_interval = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] conductor.workers              = 3 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] console.allowed_origins        = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] console.ssl_ciphers            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] console.ssl_minimum_version    = default {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] consoleauth.token_ttl          = 600 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.cafile                  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.certfile                = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.collect_timing          = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.connect_retries         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.connect_retry_delay     = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.endpoint_override       = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.insecure                = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.keyfile                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.max_version             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.min_version             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.region_name             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.service_name            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.service_type            = accelerator {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.split_loggers           = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.status_code_retries     = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.status_code_retry_delay = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.timeout                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] cyborg.version                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.backend               = sqlalchemy {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.connection            = **** {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.connection_debug      = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.connection_parameters =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.connection_recycle_time = 3600 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.connection_trace      = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.db_inc_retry_interval = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.db_max_retries        = 20 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.db_max_retry_interval = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.db_retry_interval     = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.max_overflow          = 50 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.max_pool_size         = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.max_retries           = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.mysql_enable_ndb      = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.mysql_wsrep_sync_wait = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.pool_timeout          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.retry_interval        = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.slave_connection      = **** {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] database.sqlite_synchronous    = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.backend           = sqlalchemy {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.connection        = **** {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.connection_debug  = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.connection_parameters =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.connection_recycle_time = 3600 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.connection_trace  = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.db_inc_retry_interval = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.db_max_retries    = 20 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.db_max_retry_interval = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.db_retry_interval = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.max_overflow      = 50 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.max_pool_size     = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.max_retries       = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.mysql_enable_ndb  = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.pool_timeout      = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.retry_interval    = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.slave_connection  = **** {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] api_database.sqlite_synchronous = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] devices.enabled_mdev_types     = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ephemeral_storage_encryption.enabled = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.api_servers             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.cafile                  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.certfile                = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.collect_timing          = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.connect_retries         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.connect_retry_delay     = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.debug                   = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.default_trusted_certificate_ids = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.enable_certificate_validation = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.enable_rbd_download     = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.endpoint_override       = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.insecure                = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.keyfile                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.max_version             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.min_version             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.num_retries             = 3 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.rbd_ceph_conf           =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.rbd_connect_timeout     = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.rbd_pool                =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.rbd_user                =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.region_name             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.service_name            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.service_type            = image {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.split_loggers           = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.status_code_retries     = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.status_code_retry_delay = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.timeout                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.verify_glance_signatures = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] glance.version                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] guestfs.debug                  = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.config_drive_cdrom      = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.config_drive_inject_password = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.enable_remotefx         = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.instances_path_share    =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.limit_cpu_features      = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.use_multipath_io        = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.vswitch_name            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] mks.enabled                    = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] image_cache.manager_interval   = 2400 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] image_cache.precache_concurrency = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] image_cache.remove_unused_base_images = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] image_cache.subdirectory_name  = _base {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.api_max_retries         = 60 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.api_retry_interval      = 2 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.auth_section            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.auth_type               = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.cafile                  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.certfile                = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.collect_timing          = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.connect_retries         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.connect_retry_delay     = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.endpoint_override       = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.insecure                = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.keyfile                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.max_version             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.min_version             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.partition_key           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.peer_list               = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.region_name             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.serial_console_state_timeout = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.service_name            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.service_type            = baremetal {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.split_loggers           = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.status_code_retries     = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.status_code_retry_delay = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.timeout                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ironic.version                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] key_manager.fixed_key          = **** {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.barbican_api_version  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.barbican_endpoint     = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.barbican_endpoint_type = public {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.barbican_region_name  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.cafile                = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.certfile              = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.collect_timing        = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.insecure              = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.keyfile               = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.number_of_retries     = 60 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.retry_delay           = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.send_service_user_token = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.split_loggers         = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.timeout               = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.verify_ssl            = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican.verify_ssl_path       = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican_service_user.auth_section = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican_service_user.auth_type = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican_service_user.cafile   = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican_service_user.certfile = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican_service_user.collect_timing = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican_service_user.insecure = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican_service_user.keyfile  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican_service_user.split_loggers = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] barbican_service_user.timeout  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.approle_role_id          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.approle_secret_id        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.cafile                   = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.certfile                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.collect_timing           = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.insecure                 = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.keyfile                  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.kv_mountpoint            = secret {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.kv_version               = 2 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.namespace                = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.root_token_id            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.split_loggers            = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.ssl_ca_crt_file          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.timeout                  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.use_ssl                  = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.cafile                = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.certfile              = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.collect_timing        = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.connect_retries       = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.connect_retry_delay   = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.endpoint_override     = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.insecure              = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.keyfile               = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.max_version           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.min_version           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.region_name           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.service_name          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.service_type          = identity {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.split_loggers         = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.status_code_retries   = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.status_code_retry_delay = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.timeout               = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] keystone.version               = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.connection_uri         =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.cpu_mode               = custom {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: WARNING oslo_config.cfg [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.cpu_power_governor_high = performance {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.cpu_power_management   = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.device_detach_attempts = 8 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.device_detach_timeout  = 20 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.disk_cachemodes        = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.disk_prefix            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.enabled_perf_events    = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.file_backed_memory     = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.gid_maps               = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.hw_disk_discard        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.hw_machine_type        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.images_rbd_pool        = rbd {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.images_type            = default {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.images_volume_group    = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.inject_key             = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.inject_partition       = -2 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.inject_password        = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.iscsi_iface            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.iser_use_multipath     = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.live_migration_downtime = 500 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.live_migration_inbound_addr = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.live_migration_scheme  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.live_migration_timeout_action = abort {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.live_migration_tunnelled = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: WARNING oslo_config.cfg [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 11 23:00:20 user nova-compute[71516]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 11 23:00:20 user nova-compute[71516]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 11 23:00:20 user nova-compute[71516]: and ``live_migration_inbound_addr`` respectively.
Apr 11 23:00:20 user nova-compute[71516]: ).  Its value may be silently ignored in the future.
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.live_migration_with_native_tls = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.max_queues             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.nfs_mount_options      = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.num_pcie_ports         = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.pmem_namespaces        = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.quobyte_client_cfg     = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.rbd_secret_uuid        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.rbd_user               = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.rescue_image_id        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.rescue_kernel_id       = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.rx_queue_size          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.smbfs_mount_options    =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.snapshot_compression   = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.snapshot_image_format  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.sparse_logical_volumes = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.swtpm_enabled          = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.swtpm_group            = tss {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.swtpm_user             = tss {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.sysinfo_serial         = unique {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.tx_queue_size          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.uid_maps               = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.use_virtio_for_bridges = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.virt_type              = kvm {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.volume_clear           = zero {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.volume_clear_size      = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.volume_use_multipath   = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.vzstorage_cache_path   = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.auth_section           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.auth_type              = password {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.cafile                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.certfile               = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.collect_timing         = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.connect_retries        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.connect_retry_delay    = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.default_floating_pool  = public {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.endpoint_override      = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.extension_sync_interval = 600 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.http_retries           = 3 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.insecure               = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.keyfile                = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.max_version            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.min_version            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.ovs_bridge             = br-int {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.physnets               = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.region_name            = RegionOne {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.service_metadata_proxy = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.service_name           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.service_type           = network {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.split_loggers          = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.status_code_retries    = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.status_code_retry_delay = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.timeout                = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] neutron.version                = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] notifications.bdms_in_notifications = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] notifications.default_level    = INFO {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] notifications.notification_format = unversioned {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] notifications.notify_on_state_change = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] pci.alias                      = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] pci.device_spec                = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] pci.report_in_placement        = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.auth_section         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.auth_type            = password {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.cafile               = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.certfile             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.collect_timing       = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.connect_retries      = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.connect_retry_delay  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.default_domain_id    = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.default_domain_name  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.domain_id            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.domain_name          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.endpoint_override    = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.insecure             = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.keyfile              = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.max_version          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.min_version          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.password             = **** {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.project_domain_id    = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.project_domain_name  = Default {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.project_id           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.project_name         = service {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.region_name          = RegionOne {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.service_name         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.service_type         = placement {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.split_loggers        = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.status_code_retries  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.status_code_retry_delay = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.system_scope         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.timeout              = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.trust_id             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.user_domain_id       = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.user_domain_name     = Default {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.user_id              = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.username             = placement {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] placement.version              = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] quota.cores                    = 20 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] quota.count_usage_from_placement = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] quota.injected_file_content_bytes = 10240 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] quota.injected_file_path_length = 255 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] quota.injected_files           = 5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] quota.instances                = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] quota.key_pairs                = 100 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] quota.metadata_items           = 128 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] quota.ram                      = 51200 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] quota.recheck_quota            = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] quota.server_group_members     = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] quota.server_groups            = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] rdp.enabled                    = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] scheduler.image_metadata_prefilter = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] scheduler.max_attempts         = 3 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] scheduler.max_placement_results = 1000 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] scheduler.workers              = 3 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.host_subset_size = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.isolated_hosts = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.isolated_images = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.pci_in_placement = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.track_instance_changes = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] metrics.required               = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] metrics.weight_multiplier      = 1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] metrics.weight_setting         = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] serial_console.enabled         = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] serial_console.port_range      = 10000:20000 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] serial_console.serialproxy_port = 6083 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] service_user.auth_section      = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] service_user.auth_type         = password {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] service_user.cafile            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] service_user.certfile          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] service_user.collect_timing    = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] service_user.insecure          = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] service_user.keyfile           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] service_user.send_service_user_token = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] service_user.split_loggers     = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] service_user.timeout           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] spice.agent_enabled            = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] spice.enabled                  = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] spice.html5proxy_port          = 6082 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] spice.image_compression        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] spice.jpeg_compression         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] spice.playback_compression     = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] spice.server_listen            = 127.0.0.1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] spice.streaming_mode           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] spice.zlib_compression         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] upgrade_levels.baseapi         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] upgrade_levels.cert            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] upgrade_levels.compute         = auto {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] upgrade_levels.conductor       = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] upgrade_levels.scheduler       = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vendordata_dynamic_auth.cafile = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vendordata_dynamic_auth.certfile = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vendordata_dynamic_auth.insecure = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vendordata_dynamic_auth.timeout = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.api_retry_count         = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.ca_file                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.cache_prefix            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.cluster_name            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.connection_pool_size    = 10 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.console_delay_seconds   = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.datastore_regex         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.host_ip                 = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.host_password           = **** {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.host_port               = 443 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.host_username           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.insecure                = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.integration_bridge      = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.maximum_objects         = 100 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.pbm_default_policy      = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.pbm_enabled             = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.pbm_wsdl_location       = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.serial_port_proxy_uri   = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.serial_port_service_uri = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.task_poll_interval      = 0.5 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.use_linked_clone        = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.vnc_keymap              = en-us {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.vnc_port                = 5900 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vmware.vnc_port_total          = 10000 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vnc.auth_schemes               = ['none'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vnc.enabled                    = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vnc.novncproxy_port            = 6080 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vnc.vencrypt_ca_certs          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vnc.vencrypt_client_cert       = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vnc.vencrypt_client_key        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.disable_rootwrap   = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.enable_numa_live_migration = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.libvirt_disable_apic = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] wsgi.client_socket_timeout     = 900 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] wsgi.default_pool_size         = 1000 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] wsgi.keep_alive                = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] wsgi.max_header_line           = 16384 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] wsgi.ssl_ca_file               = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] wsgi.ssl_cert_file             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] wsgi.ssl_key_file              = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] wsgi.tcp_keepidle              = 600 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] zvm.ca_file                    = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] zvm.cloud_connector_url        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] zvm.reachable_timeout          = 300 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_policy.enforce_new_defaults = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_policy.enforce_scope      = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_policy.policy_default_rule = default {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] profiler.connection_string     = messaging:// {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] profiler.enabled               = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] profiler.es_doc_type           = notification {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] profiler.es_scroll_size        = 10000 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] profiler.es_scroll_time        = 2m {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] profiler.filter_error_trace    = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] profiler.sentinel_service_name = mymaster {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] profiler.socket_timeout        = 0.1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] profiler.trace_sqlalchemy      = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] remote_debug.host              = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] remote_debug.port              = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_notifications.retry = -1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.auth_section        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.auth_type           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.cafile              = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.certfile            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.collect_timing      = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.connect_retries     = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.connect_retry_delay = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.endpoint_id         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.endpoint_override   = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.insecure            = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.keyfile             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.max_version         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.min_version         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.region_name         = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.service_name        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.service_type        = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.split_loggers       = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.status_code_retries = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.status_code_retry_delay = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.timeout             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.valid_interfaces    = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_limit.version             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_reports.file_event_handler = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] oslo_reports.log_dir           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plug_ovs_privileged.group  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] vif_plug_ovs_privileged.user   = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_ovs.isolate_vif         = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] os_brick.lock_path             = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] privsep_osbrick.capabilities   = [21] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] privsep_osbrick.group          = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] privsep_osbrick.helper_command = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] privsep_osbrick.user           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] nova_sys_admin.group           = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] nova_sys_admin.helper_command  = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] nova_sys_admin.user            = None {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG oslo_service.service [None req-d6609b5e-3a9d-4ee3-82e2-776418bf1c49 None None] ******************************************************************************** {{(pid=71516) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 11 23:00:20 user nova-compute[71516]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 11 23:00:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Starting native event thread {{(pid=71516) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Starting green dispatch thread {{(pid=71516) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Starting connection event dispatch thread {{(pid=71516) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Connecting to libvirt: qemu:///system {{(pid=71516) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f3e5c0c6590> {{(pid=71516) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 11 23:00:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f3e5c0c6590> {{(pid=71516) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 11 23:00:20 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Connection event '1' reason 'None'
Apr 11 23:00:20 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 23:00:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.mount [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Initialising _HostMountState generation 0 {{(pid=71516) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 11 23:00:28 user nova-compute[71516]: INFO nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Libvirt host capabilities <capabilities>
Apr 11 23:00:28 user nova-compute[71516]:   <host>
Apr 11 23:00:28 user nova-compute[71516]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 11 23:00:28 user nova-compute[71516]:     <cpu>
Apr 11 23:00:28 user nova-compute[71516]:       <arch>x86_64</arch>
Apr 11 23:00:28 user nova-compute[71516]:       <model>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <vendor>Intel</vendor>
Apr 11 23:00:28 user nova-compute[71516]:       <microcode version='1070'/>
Apr 11 23:00:28 user nova-compute[71516]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 11 23:00:28 user nova-compute[71516]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='ss'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='vmx'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='pcid'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='osxsave'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='hypervisor'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='arat'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='tsc_adjust'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='md-clear'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='arch-capabilities'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='invtsc'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='rsba'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature name='skip-l1dfl-vmentry'/>
Apr 11 23:00:28 user nova-compute[71516]:       <pages unit='KiB' size='4'/>
Apr 11 23:00:28 user nova-compute[71516]:       <pages unit='KiB' size='2048'/>
Apr 11 23:00:28 user nova-compute[71516]:     </cpu>
Apr 11 23:00:28 user nova-compute[71516]:     <power_management>
Apr 11 23:00:28 user nova-compute[71516]:       <suspend_mem/>
Apr 11 23:00:28 user nova-compute[71516]:       <suspend_disk/>
Apr 11 23:00:28 user nova-compute[71516]:       <suspend_hybrid/>
Apr 11 23:00:28 user nova-compute[71516]:     </power_management>
Apr 11 23:00:28 user nova-compute[71516]:     <iommu support='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     <migration_features>
Apr 11 23:00:28 user nova-compute[71516]:       <live/>
Apr 11 23:00:28 user nova-compute[71516]:       <uri_transports>
Apr 11 23:00:28 user nova-compute[71516]:         <uri_transport>tcp</uri_transport>
Apr 11 23:00:28 user nova-compute[71516]:         <uri_transport>rdma</uri_transport>
Apr 11 23:00:28 user nova-compute[71516]:       </uri_transports>
Apr 11 23:00:28 user nova-compute[71516]:     </migration_features>
Apr 11 23:00:28 user nova-compute[71516]:     <topology>
Apr 11 23:00:28 user nova-compute[71516]:       <cells num='2'>
Apr 11 23:00:28 user nova-compute[71516]:         <cell id='0'>
Apr 11 23:00:28 user nova-compute[71516]:           <memory unit='KiB'>8152920</memory>
Apr 11 23:00:28 user nova-compute[71516]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 11 23:00:28 user nova-compute[71516]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 23:00:28 user nova-compute[71516]:           <distances>
Apr 11 23:00:28 user nova-compute[71516]:             <sibling id='0' value='10'/>
Apr 11 23:00:28 user nova-compute[71516]:             <sibling id='1' value='20'/>
Apr 11 23:00:28 user nova-compute[71516]:           </distances>
Apr 11 23:00:28 user nova-compute[71516]:           <cpus num='6'>
Apr 11 23:00:28 user nova-compute[71516]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 11 23:00:28 user nova-compute[71516]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 11 23:00:28 user nova-compute[71516]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 11 23:00:28 user nova-compute[71516]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 11 23:00:28 user nova-compute[71516]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 11 23:00:28 user nova-compute[71516]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 11 23:00:28 user nova-compute[71516]:           </cpus>
Apr 11 23:00:28 user nova-compute[71516]:         </cell>
Apr 11 23:00:28 user nova-compute[71516]:         <cell id='1'>
Apr 11 23:00:28 user nova-compute[71516]:           <memory unit='KiB'>8255068</memory>
Apr 11 23:00:28 user nova-compute[71516]:           <pages unit='KiB' size='4'>2063767</pages>
Apr 11 23:00:28 user nova-compute[71516]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 23:00:28 user nova-compute[71516]:           <distances>
Apr 11 23:00:28 user nova-compute[71516]:             <sibling id='0' value='20'/>
Apr 11 23:00:28 user nova-compute[71516]:             <sibling id='1' value='10'/>
Apr 11 23:00:28 user nova-compute[71516]:           </distances>
Apr 11 23:00:28 user nova-compute[71516]:           <cpus num='6'>
Apr 11 23:00:28 user nova-compute[71516]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 11 23:00:28 user nova-compute[71516]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 11 23:00:28 user nova-compute[71516]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 11 23:00:28 user nova-compute[71516]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 11 23:00:28 user nova-compute[71516]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 11 23:00:28 user nova-compute[71516]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 11 23:00:28 user nova-compute[71516]:           </cpus>
Apr 11 23:00:28 user nova-compute[71516]:         </cell>
Apr 11 23:00:28 user nova-compute[71516]:       </cells>
Apr 11 23:00:28 user nova-compute[71516]:     </topology>
Apr 11 23:00:28 user nova-compute[71516]:     <cache>
Apr 11 23:00:28 user nova-compute[71516]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 11 23:00:28 user nova-compute[71516]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 11 23:00:28 user nova-compute[71516]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 11 23:00:28 user nova-compute[71516]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 11 23:00:28 user nova-compute[71516]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 11 23:00:28 user nova-compute[71516]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 11 23:00:28 user nova-compute[71516]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 11 23:00:28 user nova-compute[71516]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 11 23:00:28 user nova-compute[71516]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 11 23:00:28 user nova-compute[71516]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 11 23:00:28 user nova-compute[71516]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 11 23:00:28 user nova-compute[71516]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 11 23:00:28 user nova-compute[71516]:     </cache>
Apr 11 23:00:28 user nova-compute[71516]:     <secmodel>
Apr 11 23:00:28 user nova-compute[71516]:       <model>apparmor</model>
Apr 11 23:00:28 user nova-compute[71516]:       <doi>0</doi>
Apr 11 23:00:28 user nova-compute[71516]:     </secmodel>
Apr 11 23:00:28 user nova-compute[71516]:     <secmodel>
Apr 11 23:00:28 user nova-compute[71516]:       <model>dac</model>
Apr 11 23:00:28 user nova-compute[71516]:       <doi>0</doi>
Apr 11 23:00:28 user nova-compute[71516]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 11 23:00:28 user nova-compute[71516]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 11 23:00:28 user nova-compute[71516]:     </secmodel>
Apr 11 23:00:28 user nova-compute[71516]:   </host>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='alpha'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>64</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>clipper</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='armv6l'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>spitz</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>nuri</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>kzm</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sx1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>z2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>tosa</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>n810</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>n800</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>terrier</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>midway</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>microbit</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>verdex</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>highbank</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>akita</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>connex</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>collie</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='armv7l'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>spitz</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>nuri</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>kzm</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sx1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>z2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>tosa</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>n810</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>n800</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>terrier</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>midway</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>microbit</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>verdex</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>highbank</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>akita</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>connex</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>collie</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='aarch64'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>64</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>spitz</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>nuri</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>kzm</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sx1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>z2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>tosa</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>n810</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>n800</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>terrier</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>midway</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>microbit</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>verdex</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>raspi3b</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>highbank</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>akita</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>connex</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>collie</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <acpi default='on' toggle='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='cris'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='i686'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>isapc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>microvm</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='kvm'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <pae/>
Apr 11 23:00:28 user nova-compute[71516]:       <nonpae/>
Apr 11 23:00:28 user nova-compute[71516]:       <acpi default='on' toggle='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:       <apic default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='m68k'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>an5206</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>q800</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>next-cube</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='microblaze'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='microblazeel'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='mips'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='16'>malta</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='mipsel'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='16'>malta</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='mips64'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>64</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='16'>malta</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>pica61</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>magnum</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='mips64el'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>64</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='16'>malta</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>pica61</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>magnum</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='16'>boston</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='ppc'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mac99</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>40p</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>taihu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='ppc64'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>64</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>taihu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>40p</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mac99</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='ppc64le'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>64</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>taihu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>40p</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>mac99</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='riscv32'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='8'>spike</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>opentitan</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='8'>virt</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='riscv64'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>64</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='8'>spike</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>shakti_c</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='8'>virt</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='s390x'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>64</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='sh4'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>shix</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>r2d</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='sh4eb'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>64</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>shix</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>r2d</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='sparc'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>SS-5</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>SS-20</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>LX</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>SS-4</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>SS-10</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>Voyager</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='sparc64'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>64</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sun4u</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>niagara</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>sun4v</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='x86_64'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>64</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='1'>isapc</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>microvm</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='kvm'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <acpi default='on' toggle='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:       <apic default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='xtensa'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>sim</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>kc705</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>ml605</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>virt</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>lx200</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>lx60</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]:   <guest>
Apr 11 23:00:28 user nova-compute[71516]:     <os_type>hvm</os_type>
Apr 11 23:00:28 user nova-compute[71516]:     <arch name='xtensaeb'>
Apr 11 23:00:28 user nova-compute[71516]:       <wordsize>32</wordsize>
Apr 11 23:00:28 user nova-compute[71516]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='4'>sim</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>kc705</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>ml605</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>virt</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>lx200</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>lx60</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 23:00:28 user nova-compute[71516]:       <domain type='qemu'/>
Apr 11 23:00:28 user nova-compute[71516]:     </arch>
Apr 11 23:00:28 user nova-compute[71516]:     <features>
Apr 11 23:00:28 user nova-compute[71516]:       <cpuselection/>
Apr 11 23:00:28 user nova-compute[71516]:       <deviceboot/>
Apr 11 23:00:28 user nova-compute[71516]:       <disksnapshot default='on' toggle='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     </features>
Apr 11 23:00:28 user nova-compute[71516]:   </guest>
Apr 11 23:00:28 user nova-compute[71516]: </capabilities>
Apr 11 23:00:28 user nova-compute[71516]: 
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 11 23:00:28 user nova-compute[71516]: <domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 23:00:28 user nova-compute[71516]:   <domain>kvm</domain>
Apr 11 23:00:28 user nova-compute[71516]:   <machine>pc-i440fx-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:   <arch>i686</arch>
Apr 11 23:00:28 user nova-compute[71516]:   <vcpu max='255'/>
Apr 11 23:00:28 user nova-compute[71516]:   <iothreads supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:   <os supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='firmware'/>
Apr 11 23:00:28 user nova-compute[71516]:     <loader supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>rom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pflash</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='readonly'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>yes</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='secure'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </loader>
Apr 11 23:00:28 user nova-compute[71516]:   </os>
Apr 11 23:00:28 user nova-compute[71516]:   <cpu>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-passthrough' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='hostPassthroughMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='maximum' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='maximumMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>on</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-model' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <vendor>Intel</vendor>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ss'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='vmx'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='pcid'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='hypervisor'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arat'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='umip'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='md-clear'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibpb'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibrs'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='erms'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='lm'/>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='custom' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>qemu64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>qemu32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>phenom</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>n270</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>kvm64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>kvm32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>coreduo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>core2duo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>athlon</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Westmere</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Snowridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Penryn</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G5</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G4</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G1</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Nehalem</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Rome</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Milan</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Dhyana</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cooperlake</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Conroe</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>486</model>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:   </cpu>
Apr 11 23:00:28 user nova-compute[71516]:   <memoryBacking supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='sourceType'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>file</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>anonymous</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>memfd</value>
Apr 11 23:00:28 user nova-compute[71516]:     </enum>
Apr 11 23:00:28 user nova-compute[71516]:   </memoryBacking>
Apr 11 23:00:28 user nova-compute[71516]:   <devices>
Apr 11 23:00:28 user nova-compute[71516]:     <disk supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='diskDevice'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>disk</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cdrom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>floppy</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>lun</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='bus'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>ide</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>fdc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sata</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </disk>
Apr 11 23:00:28 user nova-compute[71516]:     <graphics supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sdl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vnc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>spice</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egl-headless</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </graphics>
Apr 11 23:00:28 user nova-compute[71516]:     <video supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='modelType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cirrus</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vmvga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>qxl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>none</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>bochs</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>ramfb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </video>
Apr 11 23:00:28 user nova-compute[71516]:     <hostdev supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='mode'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>subsystem</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='startupPolicy'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>default</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>mandatory</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>requisite</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>optional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='subsysType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pci</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='capsType'/>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='pciBackend'/>
Apr 11 23:00:28 user nova-compute[71516]:     </hostdev>
Apr 11 23:00:28 user nova-compute[71516]:     <rng supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>random</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egd</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>builtin</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </rng>
Apr 11 23:00:28 user nova-compute[71516]:     <filesystem supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='driverType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>path</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>handle</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtiofs</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </filesystem>
Apr 11 23:00:28 user nova-compute[71516]:     <tpm supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-tis</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-crb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>passthrough</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>emulator</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </tpm>
Apr 11 23:00:28 user nova-compute[71516]:   </devices>
Apr 11 23:00:28 user nova-compute[71516]:   <features>
Apr 11 23:00:28 user nova-compute[71516]:     <gic supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     <vmcoreinfo supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <genid supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backingStoreInput supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backup supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <sev supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:   </features>
Apr 11 23:00:28 user nova-compute[71516]: </domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:  {{(pid=71516) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 11 23:00:28 user nova-compute[71516]: <domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 23:00:28 user nova-compute[71516]:   <domain>kvm</domain>
Apr 11 23:00:28 user nova-compute[71516]:   <machine>pc-q35-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:   <arch>i686</arch>
Apr 11 23:00:28 user nova-compute[71516]:   <vcpu max='288'/>
Apr 11 23:00:28 user nova-compute[71516]:   <iothreads supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:   <os supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='firmware'/>
Apr 11 23:00:28 user nova-compute[71516]:     <loader supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>rom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pflash</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='readonly'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>yes</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='secure'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </loader>
Apr 11 23:00:28 user nova-compute[71516]:   </os>
Apr 11 23:00:28 user nova-compute[71516]:   <cpu>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-passthrough' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='hostPassthroughMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='maximum' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='maximumMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>on</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-model' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <vendor>Intel</vendor>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ss'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='vmx'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='pcid'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='hypervisor'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arat'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='umip'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='md-clear'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibpb'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibrs'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='erms'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='lm'/>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='custom' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>qemu64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>qemu32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>phenom</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>n270</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>kvm64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>kvm32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>coreduo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>core2duo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>athlon</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Westmere</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Snowridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Penryn</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G5</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G4</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G1</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Nehalem</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Rome</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Milan</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Dhyana</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cooperlake</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Conroe</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>486</model>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:   </cpu>
Apr 11 23:00:28 user nova-compute[71516]:   <memoryBacking supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='sourceType'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>file</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>anonymous</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>memfd</value>
Apr 11 23:00:28 user nova-compute[71516]:     </enum>
Apr 11 23:00:28 user nova-compute[71516]:   </memoryBacking>
Apr 11 23:00:28 user nova-compute[71516]:   <devices>
Apr 11 23:00:28 user nova-compute[71516]:     <disk supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='diskDevice'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>disk</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cdrom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>floppy</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>lun</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='bus'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>fdc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sata</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </disk>
Apr 11 23:00:28 user nova-compute[71516]:     <graphics supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sdl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vnc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>spice</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egl-headless</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </graphics>
Apr 11 23:00:28 user nova-compute[71516]:     <video supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='modelType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cirrus</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vmvga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>qxl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>none</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>bochs</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>ramfb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </video>
Apr 11 23:00:28 user nova-compute[71516]:     <hostdev supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='mode'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>subsystem</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='startupPolicy'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>default</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>mandatory</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>requisite</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>optional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='subsysType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pci</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='capsType'/>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='pciBackend'/>
Apr 11 23:00:28 user nova-compute[71516]:     </hostdev>
Apr 11 23:00:28 user nova-compute[71516]:     <rng supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>random</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egd</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>builtin</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </rng>
Apr 11 23:00:28 user nova-compute[71516]:     <filesystem supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='driverType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>path</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>handle</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtiofs</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </filesystem>
Apr 11 23:00:28 user nova-compute[71516]:     <tpm supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-tis</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-crb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>passthrough</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>emulator</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </tpm>
Apr 11 23:00:28 user nova-compute[71516]:   </devices>
Apr 11 23:00:28 user nova-compute[71516]:   <features>
Apr 11 23:00:28 user nova-compute[71516]:     <gic supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     <vmcoreinfo supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <genid supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backingStoreInput supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backup supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <sev supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:   </features>
Apr 11 23:00:28 user nova-compute[71516]: </domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:  {{(pid=71516) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 11 23:00:28 user nova-compute[71516]: <domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 23:00:28 user nova-compute[71516]:   <domain>kvm</domain>
Apr 11 23:00:28 user nova-compute[71516]:   <machine>pc-q35-jammy</machine>
Apr 11 23:00:28 user nova-compute[71516]:   <arch>i686</arch>
Apr 11 23:00:28 user nova-compute[71516]:   <vcpu max='288'/>
Apr 11 23:00:28 user nova-compute[71516]:   <iothreads supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:   <os supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='firmware'/>
Apr 11 23:00:28 user nova-compute[71516]:     <loader supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>rom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pflash</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='readonly'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>yes</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='secure'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </loader>
Apr 11 23:00:28 user nova-compute[71516]:   </os>
Apr 11 23:00:28 user nova-compute[71516]:   <cpu>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-passthrough' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='hostPassthroughMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='maximum' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='maximumMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>on</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-model' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <vendor>Intel</vendor>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ss'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='vmx'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='pcid'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='hypervisor'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arat'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='umip'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='md-clear'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibpb'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibrs'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='erms'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='lm'/>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='custom' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>qemu64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>qemu32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>phenom</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>n270</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>kvm64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>kvm32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>coreduo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>core2duo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>athlon</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Westmere</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Snowridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Penryn</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G5</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G4</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G1</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Nehalem</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Rome</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Milan</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Dhyana</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cooperlake</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Conroe</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>486</model>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:   </cpu>
Apr 11 23:00:28 user nova-compute[71516]:   <memoryBacking supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='sourceType'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>file</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>anonymous</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>memfd</value>
Apr 11 23:00:28 user nova-compute[71516]:     </enum>
Apr 11 23:00:28 user nova-compute[71516]:   </memoryBacking>
Apr 11 23:00:28 user nova-compute[71516]:   <devices>
Apr 11 23:00:28 user nova-compute[71516]:     <disk supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='diskDevice'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>disk</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cdrom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>floppy</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>lun</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='bus'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>fdc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sata</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </disk>
Apr 11 23:00:28 user nova-compute[71516]:     <graphics supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sdl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vnc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>spice</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egl-headless</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </graphics>
Apr 11 23:00:28 user nova-compute[71516]:     <video supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='modelType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cirrus</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vmvga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>qxl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>none</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>bochs</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>ramfb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </video>
Apr 11 23:00:28 user nova-compute[71516]:     <hostdev supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='mode'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>subsystem</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='startupPolicy'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>default</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>mandatory</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>requisite</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>optional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='subsysType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pci</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='capsType'/>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='pciBackend'/>
Apr 11 23:00:28 user nova-compute[71516]:     </hostdev>
Apr 11 23:00:28 user nova-compute[71516]:     <rng supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>random</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egd</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>builtin</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </rng>
Apr 11 23:00:28 user nova-compute[71516]:     <filesystem supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='driverType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>path</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>handle</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtiofs</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </filesystem>
Apr 11 23:00:28 user nova-compute[71516]:     <tpm supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-tis</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-crb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>passthrough</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>emulator</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </tpm>
Apr 11 23:00:28 user nova-compute[71516]:   </devices>
Apr 11 23:00:28 user nova-compute[71516]:   <features>
Apr 11 23:00:28 user nova-compute[71516]:     <gic supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     <vmcoreinfo supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <genid supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backingStoreInput supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backup supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <sev supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:   </features>
Apr 11 23:00:28 user nova-compute[71516]: </domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:  {{(pid=71516) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 11 23:00:28 user nova-compute[71516]: <domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 23:00:28 user nova-compute[71516]:   <domain>kvm</domain>
Apr 11 23:00:28 user nova-compute[71516]:   <machine>pc-i440fx-jammy</machine>
Apr 11 23:00:28 user nova-compute[71516]:   <arch>i686</arch>
Apr 11 23:00:28 user nova-compute[71516]:   <vcpu max='255'/>
Apr 11 23:00:28 user nova-compute[71516]:   <iothreads supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:   <os supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='firmware'/>
Apr 11 23:00:28 user nova-compute[71516]:     <loader supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>rom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pflash</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='readonly'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>yes</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='secure'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </loader>
Apr 11 23:00:28 user nova-compute[71516]:   </os>
Apr 11 23:00:28 user nova-compute[71516]:   <cpu>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-passthrough' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='hostPassthroughMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='maximum' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='maximumMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>on</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-model' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <vendor>Intel</vendor>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ss'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='vmx'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='pcid'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='hypervisor'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arat'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='umip'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='md-clear'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibpb'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibrs'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='erms'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='lm'/>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='custom' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>qemu64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>qemu32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>phenom</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>n270</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>kvm64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>kvm32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>coreduo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>core2duo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>athlon</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Westmere</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Snowridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Penryn</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G5</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G4</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G1</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Nehalem</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Rome</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Milan</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Dhyana</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cooperlake</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Conroe</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>486</model>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:   </cpu>
Apr 11 23:00:28 user nova-compute[71516]:   <memoryBacking supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='sourceType'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>file</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>anonymous</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>memfd</value>
Apr 11 23:00:28 user nova-compute[71516]:     </enum>
Apr 11 23:00:28 user nova-compute[71516]:   </memoryBacking>
Apr 11 23:00:28 user nova-compute[71516]:   <devices>
Apr 11 23:00:28 user nova-compute[71516]:     <disk supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='diskDevice'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>disk</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cdrom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>floppy</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>lun</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='bus'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>ide</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>fdc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sata</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </disk>
Apr 11 23:00:28 user nova-compute[71516]:     <graphics supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sdl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vnc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>spice</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egl-headless</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </graphics>
Apr 11 23:00:28 user nova-compute[71516]:     <video supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='modelType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cirrus</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vmvga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>qxl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>none</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>bochs</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>ramfb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </video>
Apr 11 23:00:28 user nova-compute[71516]:     <hostdev supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='mode'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>subsystem</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='startupPolicy'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>default</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>mandatory</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>requisite</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>optional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='subsysType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pci</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='capsType'/>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='pciBackend'/>
Apr 11 23:00:28 user nova-compute[71516]:     </hostdev>
Apr 11 23:00:28 user nova-compute[71516]:     <rng supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>random</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egd</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>builtin</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </rng>
Apr 11 23:00:28 user nova-compute[71516]:     <filesystem supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='driverType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>path</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>handle</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtiofs</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </filesystem>
Apr 11 23:00:28 user nova-compute[71516]:     <tpm supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-tis</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-crb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>passthrough</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>emulator</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </tpm>
Apr 11 23:00:28 user nova-compute[71516]:   </devices>
Apr 11 23:00:28 user nova-compute[71516]:   <features>
Apr 11 23:00:28 user nova-compute[71516]:     <gic supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     <vmcoreinfo supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <genid supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backingStoreInput supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backup supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <sev supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:   </features>
Apr 11 23:00:28 user nova-compute[71516]: </domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:  {{(pid=71516) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 11 23:00:28 user nova-compute[71516]: <domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 23:00:28 user nova-compute[71516]:   <domain>kvm</domain>
Apr 11 23:00:28 user nova-compute[71516]:   <machine>pc-i440fx-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:   <arch>x86_64</arch>
Apr 11 23:00:28 user nova-compute[71516]:   <vcpu max='255'/>
Apr 11 23:00:28 user nova-compute[71516]:   <iothreads supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:   <os supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='firmware'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>efi</value>
Apr 11 23:00:28 user nova-compute[71516]:     </enum>
Apr 11 23:00:28 user nova-compute[71516]:     <loader supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>rom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pflash</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='readonly'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>yes</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='secure'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </loader>
Apr 11 23:00:28 user nova-compute[71516]:   </os>
Apr 11 23:00:28 user nova-compute[71516]:   <cpu>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-passthrough' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='hostPassthroughMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>on</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='maximum' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='maximumMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>on</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-model' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <vendor>Intel</vendor>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ss'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='vmx'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='pcid'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='hypervisor'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arat'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='umip'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='md-clear'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='invtsc'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibpb'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibrs'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='rsba'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='erms'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='custom' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>qemu64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>qemu32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>phenom</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>n270</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>kvm64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>kvm32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>coreduo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>core2duo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>athlon</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Westmere</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Snowridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Penryn</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G5</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G4</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Opteron_G1</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Nehalem</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Rome</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Milan</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Dhyana</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cooperlake</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Conroe</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>486</model>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:   </cpu>
Apr 11 23:00:28 user nova-compute[71516]:   <memoryBacking supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='sourceType'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>file</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>anonymous</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>memfd</value>
Apr 11 23:00:28 user nova-compute[71516]:     </enum>
Apr 11 23:00:28 user nova-compute[71516]:   </memoryBacking>
Apr 11 23:00:28 user nova-compute[71516]:   <devices>
Apr 11 23:00:28 user nova-compute[71516]:     <disk supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='diskDevice'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>disk</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cdrom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>floppy</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>lun</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='bus'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>ide</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>fdc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sata</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </disk>
Apr 11 23:00:28 user nova-compute[71516]:     <graphics supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sdl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vnc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>spice</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egl-headless</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </graphics>
Apr 11 23:00:28 user nova-compute[71516]:     <video supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='modelType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cirrus</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vmvga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>qxl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>none</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>bochs</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>ramfb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </video>
Apr 11 23:00:28 user nova-compute[71516]:     <hostdev supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='mode'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>subsystem</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='startupPolicy'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>default</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>mandatory</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>requisite</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>optional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='subsysType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pci</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='capsType'/>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='pciBackend'/>
Apr 11 23:00:28 user nova-compute[71516]:     </hostdev>
Apr 11 23:00:28 user nova-compute[71516]:     <rng supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>random</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egd</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>builtin</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </rng>
Apr 11 23:00:28 user nova-compute[71516]:     <filesystem supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='driverType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>path</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>handle</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtiofs</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </filesystem>
Apr 11 23:00:28 user nova-compute[71516]:     <tpm supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-tis</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-crb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>passthrough</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>emulator</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </tpm>
Apr 11 23:00:28 user nova-compute[71516]:   </devices>
Apr 11 23:00:28 user nova-compute[71516]:   <features>
Apr 11 23:00:28 user nova-compute[71516]:     <gic supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     <vmcoreinfo supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <genid supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backingStoreInput supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backup supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <sev supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:   </features>
Apr 11 23:00:28 user nova-compute[71516]: </domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:  {{(pid=71516) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 11 23:00:28 user nova-compute[71516]: <domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 23:00:28 user nova-compute[71516]:   <domain>kvm</domain>
Apr 11 23:00:28 user nova-compute[71516]:   <machine>pc-q35-6.2</machine>
Apr 11 23:00:28 user nova-compute[71516]:   <arch>x86_64</arch>
Apr 11 23:00:28 user nova-compute[71516]:   <vcpu max='288'/>
Apr 11 23:00:28 user nova-compute[71516]:   <iothreads supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:   <os supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='firmware'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>efi</value>
Apr 11 23:00:28 user nova-compute[71516]:     </enum>
Apr 11 23:00:28 user nova-compute[71516]:     <loader supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>rom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pflash</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='readonly'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>yes</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='secure'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>yes</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </loader>
Apr 11 23:00:28 user nova-compute[71516]:   </os>
Apr 11 23:00:28 user nova-compute[71516]:   <cpu>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-passthrough' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='hostPassthroughMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>on</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='maximum' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='maximumMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>on</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-model' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <vendor>Intel</vendor>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ss'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='vmx'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='pcid'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='hypervisor'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arat'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='umip'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='md-clear'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='invtsc'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibpb'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibrs'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='rsba'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='erms'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='custom' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>qemu64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>qemu32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>phenom</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>n270</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>kvm64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>kvm32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>coreduo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>core2duo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>athlon</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Westmere</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Snowridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Penryn</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G5</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G4</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Opteron_G1</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Nehalem</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Rome</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Milan</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Dhyana</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cooperlake</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Conroe</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>486</model>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:   </cpu>
Apr 11 23:00:28 user nova-compute[71516]:   <memoryBacking supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='sourceType'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>file</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>anonymous</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>memfd</value>
Apr 11 23:00:28 user nova-compute[71516]:     </enum>
Apr 11 23:00:28 user nova-compute[71516]:   </memoryBacking>
Apr 11 23:00:28 user nova-compute[71516]:   <devices>
Apr 11 23:00:28 user nova-compute[71516]:     <disk supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='diskDevice'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>disk</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cdrom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>floppy</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>lun</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='bus'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>fdc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sata</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </disk>
Apr 11 23:00:28 user nova-compute[71516]:     <graphics supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sdl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vnc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>spice</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egl-headless</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </graphics>
Apr 11 23:00:28 user nova-compute[71516]:     <video supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='modelType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cirrus</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vmvga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>qxl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>none</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>bochs</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>ramfb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </video>
Apr 11 23:00:28 user nova-compute[71516]:     <hostdev supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='mode'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>subsystem</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='startupPolicy'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>default</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>mandatory</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>requisite</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>optional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='subsysType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pci</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='capsType'/>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='pciBackend'/>
Apr 11 23:00:28 user nova-compute[71516]:     </hostdev>
Apr 11 23:00:28 user nova-compute[71516]:     <rng supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>random</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egd</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>builtin</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </rng>
Apr 11 23:00:28 user nova-compute[71516]:     <filesystem supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='driverType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>path</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>handle</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtiofs</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </filesystem>
Apr 11 23:00:28 user nova-compute[71516]:     <tpm supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-tis</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-crb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>passthrough</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>emulator</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </tpm>
Apr 11 23:00:28 user nova-compute[71516]:   </devices>
Apr 11 23:00:28 user nova-compute[71516]:   <features>
Apr 11 23:00:28 user nova-compute[71516]:     <gic supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     <vmcoreinfo supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <genid supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backingStoreInput supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backup supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <sev supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:   </features>
Apr 11 23:00:28 user nova-compute[71516]: </domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:  {{(pid=71516) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 11 23:00:28 user nova-compute[71516]: <domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 23:00:28 user nova-compute[71516]:   <domain>kvm</domain>
Apr 11 23:00:28 user nova-compute[71516]:   <machine>pc-q35-jammy</machine>
Apr 11 23:00:28 user nova-compute[71516]:   <arch>x86_64</arch>
Apr 11 23:00:28 user nova-compute[71516]:   <vcpu max='288'/>
Apr 11 23:00:28 user nova-compute[71516]:   <iothreads supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:   <os supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='firmware'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>efi</value>
Apr 11 23:00:28 user nova-compute[71516]:     </enum>
Apr 11 23:00:28 user nova-compute[71516]:     <loader supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>rom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pflash</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='readonly'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>yes</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='secure'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>yes</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </loader>
Apr 11 23:00:28 user nova-compute[71516]:   </os>
Apr 11 23:00:28 user nova-compute[71516]:   <cpu>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-passthrough' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='hostPassthroughMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>on</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='maximum' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='maximumMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>on</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-model' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <vendor>Intel</vendor>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ss'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='vmx'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='pcid'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='hypervisor'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arat'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='umip'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='md-clear'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='invtsc'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibpb'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibrs'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='rsba'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='erms'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='custom' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>qemu64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>qemu32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>phenom</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>n270</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>kvm64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>kvm32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>coreduo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>core2duo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>athlon</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Westmere</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Snowridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Penryn</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G5</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G4</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Opteron_G1</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Nehalem</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Rome</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Milan</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Dhyana</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cooperlake</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Conroe</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>486</model>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:   </cpu>
Apr 11 23:00:28 user nova-compute[71516]:   <memoryBacking supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='sourceType'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>file</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>anonymous</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>memfd</value>
Apr 11 23:00:28 user nova-compute[71516]:     </enum>
Apr 11 23:00:28 user nova-compute[71516]:   </memoryBacking>
Apr 11 23:00:28 user nova-compute[71516]:   <devices>
Apr 11 23:00:28 user nova-compute[71516]:     <disk supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='diskDevice'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>disk</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cdrom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>floppy</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>lun</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='bus'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>fdc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sata</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </disk>
Apr 11 23:00:28 user nova-compute[71516]:     <graphics supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sdl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vnc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>spice</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egl-headless</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </graphics>
Apr 11 23:00:28 user nova-compute[71516]:     <video supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='modelType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cirrus</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vmvga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>qxl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>none</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>bochs</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>ramfb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </video>
Apr 11 23:00:28 user nova-compute[71516]:     <hostdev supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='mode'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>subsystem</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='startupPolicy'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>default</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>mandatory</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>requisite</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>optional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='subsysType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pci</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='capsType'/>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='pciBackend'/>
Apr 11 23:00:28 user nova-compute[71516]:     </hostdev>
Apr 11 23:00:28 user nova-compute[71516]:     <rng supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>random</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egd</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>builtin</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </rng>
Apr 11 23:00:28 user nova-compute[71516]:     <filesystem supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='driverType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>path</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>handle</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtiofs</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </filesystem>
Apr 11 23:00:28 user nova-compute[71516]:     <tpm supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-tis</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-crb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>passthrough</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>emulator</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </tpm>
Apr 11 23:00:28 user nova-compute[71516]:   </devices>
Apr 11 23:00:28 user nova-compute[71516]:   <features>
Apr 11 23:00:28 user nova-compute[71516]:     <gic supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     <vmcoreinfo supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <genid supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backingStoreInput supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backup supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <sev supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:   </features>
Apr 11 23:00:28 user nova-compute[71516]: </domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:  {{(pid=71516) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 11 23:00:28 user nova-compute[71516]: <domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 23:00:28 user nova-compute[71516]:   <domain>kvm</domain>
Apr 11 23:00:28 user nova-compute[71516]:   <machine>pc-i440fx-jammy</machine>
Apr 11 23:00:28 user nova-compute[71516]:   <arch>x86_64</arch>
Apr 11 23:00:28 user nova-compute[71516]:   <vcpu max='255'/>
Apr 11 23:00:28 user nova-compute[71516]:   <iothreads supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:   <os supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='firmware'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>efi</value>
Apr 11 23:00:28 user nova-compute[71516]:     </enum>
Apr 11 23:00:28 user nova-compute[71516]:     <loader supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>rom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pflash</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='readonly'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>yes</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='secure'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>no</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </loader>
Apr 11 23:00:28 user nova-compute[71516]:   </os>
Apr 11 23:00:28 user nova-compute[71516]:   <cpu>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-passthrough' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='hostPassthroughMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>on</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='maximum' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='maximumMigratable'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>on</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>off</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='host-model' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <vendor>Intel</vendor>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ss'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='vmx'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='pcid'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='hypervisor'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arat'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='umip'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='md-clear'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='invtsc'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibpb'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='ibrs'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-stibp'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='rsba'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='erms'/>
Apr 11 23:00:28 user nova-compute[71516]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:     <mode name='custom' supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>qemu64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>qemu32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>phenom</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>pentium</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>n270</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>kvm64</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>kvm32</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>coreduo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>core2duo</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>athlon</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Westmere</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Snowridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Skylake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>SandyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Penryn</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G5</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G4</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G3</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Opteron_G2</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Opteron_G1</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Nehalem</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>IvyBridge</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Icelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Haswell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Rome</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-Milan</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>EPYC</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Dhyana</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cooperlake</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>Conroe</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='no'>Broadwell</model>
Apr 11 23:00:28 user nova-compute[71516]:       <model usable='yes'>486</model>
Apr 11 23:00:28 user nova-compute[71516]:     </mode>
Apr 11 23:00:28 user nova-compute[71516]:   </cpu>
Apr 11 23:00:28 user nova-compute[71516]:   <memoryBacking supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:     <enum name='sourceType'>
Apr 11 23:00:28 user nova-compute[71516]:       <value>file</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>anonymous</value>
Apr 11 23:00:28 user nova-compute[71516]:       <value>memfd</value>
Apr 11 23:00:28 user nova-compute[71516]:     </enum>
Apr 11 23:00:28 user nova-compute[71516]:   </memoryBacking>
Apr 11 23:00:28 user nova-compute[71516]:   <devices>
Apr 11 23:00:28 user nova-compute[71516]:     <disk supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='diskDevice'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>disk</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cdrom</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>floppy</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>lun</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='bus'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>ide</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>fdc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sata</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </disk>
Apr 11 23:00:28 user nova-compute[71516]:     <graphics supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='type'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>sdl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vnc</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>spice</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egl-headless</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </graphics>
Apr 11 23:00:28 user nova-compute[71516]:     <video supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='modelType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>cirrus</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>vmvga</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>qxl</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>none</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>bochs</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>ramfb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </video>
Apr 11 23:00:28 user nova-compute[71516]:     <hostdev supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='mode'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>subsystem</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='startupPolicy'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>default</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>mandatory</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>requisite</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>optional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='subsysType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>usb</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>pci</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>scsi</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='capsType'/>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='pciBackend'/>
Apr 11 23:00:28 user nova-compute[71516]:     </hostdev>
Apr 11 23:00:28 user nova-compute[71516]:     <rng supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtio-non-transitional</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>random</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>egd</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>builtin</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </rng>
Apr 11 23:00:28 user nova-compute[71516]:     <filesystem supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='driverType'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>path</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>handle</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>virtiofs</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </filesystem>
Apr 11 23:00:28 user nova-compute[71516]:     <tpm supported='yes'>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='model'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-tis</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>tpm-crb</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:       <enum name='backendModel'>
Apr 11 23:00:28 user nova-compute[71516]:         <value>passthrough</value>
Apr 11 23:00:28 user nova-compute[71516]:         <value>emulator</value>
Apr 11 23:00:28 user nova-compute[71516]:       </enum>
Apr 11 23:00:28 user nova-compute[71516]:     </tpm>
Apr 11 23:00:28 user nova-compute[71516]:   </devices>
Apr 11 23:00:28 user nova-compute[71516]:   <features>
Apr 11 23:00:28 user nova-compute[71516]:     <gic supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:     <vmcoreinfo supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <genid supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backingStoreInput supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <backup supported='yes'/>
Apr 11 23:00:28 user nova-compute[71516]:     <sev supported='no'/>
Apr 11 23:00:28 user nova-compute[71516]:   </features>
Apr 11 23:00:28 user nova-compute[71516]: </domainCapabilities>
Apr 11 23:00:28 user nova-compute[71516]:  {{(pid=71516) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71516) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71516) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Checking secure boot support for host arch (x86_64) {{(pid=71516) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Checking secure boot support for host arch (x86_64) {{(pid=71516) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Checking secure boot support for host arch (x86_64) {{(pid=71516) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 23:00:28 user nova-compute[71516]: INFO nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Secure Boot support detected
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] cpu compare xml: <cpu match="exact">
Apr 11 23:00:28 user nova-compute[71516]:   <model>Nehalem</model>
Apr 11 23:00:28 user nova-compute[71516]: </cpu>
Apr 11 23:00:28 user nova-compute[71516]:  {{(pid=71516) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 11 23:00:28 user nova-compute[71516]: INFO nova.virt.node [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Generated node identity 4d8a043f-686c-4589-9f1b-5d9579db89a3
Apr 11 23:00:28 user nova-compute[71516]: INFO nova.virt.node [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Wrote node identity 4d8a043f-686c-4589-9f1b-5d9579db89a3 to /opt/stack/data/nova/compute_id
Apr 11 23:00:28 user nova-compute[71516]: WARNING nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Compute nodes ['4d8a043f-686c-4589-9f1b-5d9579db89a3'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 11 23:00:28 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 11 23:00:28 user nova-compute[71516]: WARNING nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 23:00:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:00:28 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:00:29 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:00:29 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Hypervisor/Node resource view: name=user free_ram=10874MB free_disk=27.033645629882812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:00:29 user nova-compute[71516]: WARNING nova.compute.resource_tracker [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] No compute node record for user:4d8a043f-686c-4589-9f1b-5d9579db89a3: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 4d8a043f-686c-4589-9f1b-5d9579db89a3 could not be found.
Apr 11 23:00:29 user nova-compute[71516]: INFO nova.compute.resource_tracker [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Compute node record created for user:user with uuid: 4d8a043f-686c-4589-9f1b-5d9579db89a3
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:00:29 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [req-c36ce52f-08b7-4a38-af91-3d0dbd50bb16] Created resource provider record via placement API for resource provider with UUID 4d8a043f-686c-4589-9f1b-5d9579db89a3 and name user.
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71516) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 11 23:00:29 user nova-compute[71516]: INFO nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] kernel doesn't support AMD SEV
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Updating inventory in ProviderTree for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Libvirt baseline CPU <cpu>
Apr 11 23:00:29 user nova-compute[71516]:   <arch>x86_64</arch>
Apr 11 23:00:29 user nova-compute[71516]:   <model>Nehalem</model>
Apr 11 23:00:29 user nova-compute[71516]:   <vendor>Intel</vendor>
Apr 11 23:00:29 user nova-compute[71516]:   <topology sockets="6" cores="1" threads="1"/>
Apr 11 23:00:29 user nova-compute[71516]: </cpu>
Apr 11 23:00:29 user nova-compute[71516]:  {{(pid=71516) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Updated inventory for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Updating resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 generation from 0 to 1 during operation: update_inventory {{(pid=71516) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Updating inventory in ProviderTree for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Updating resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 generation from 1 to 2 during operation: update_traits {{(pid=71516) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.service [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Creating RPC server for service compute {{(pid=71516) start /opt/stack/nova/nova/service.py:182}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.service [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Join ServiceGroup membership for this service compute {{(pid=71516) start /opt/stack/nova/nova/service.py:199}}
Apr 11 23:00:29 user nova-compute[71516]: DEBUG nova.servicegroup.drivers.db [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71516) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 11 23:00:49 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_power_states {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:00:49 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:01:20 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:01:20 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:01:20 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=10297MB free_disk=26.947467803955078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:01:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:02:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:02:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:02:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:02:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:02:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:02:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:02:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:02:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:02:21 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:02:21 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:02:21 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=10225MB free_disk=26.994850158691406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:02:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:02:22 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:02:22 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:03:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:03:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:03:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:03:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:03:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:03:22 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:03:22 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:03:22 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=10208MB free_disk=26.76958465576172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:03:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:03:23 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:03:23 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:03:23 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:04:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:04:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:04:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:04:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:04:21 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:04:22 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:04:23 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:04:24 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:04:24 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:04:24 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=9475MB free_disk=26.791587829589844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:04:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:25 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:04:25 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:04:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:42 user nova-compute[71516]: DEBUG nova.compute.manager [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:04:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:04:42 user nova-compute[71516]: INFO nova.compute.claims [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Claim successful on node user
Apr 11 23:04:43 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:04:43 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:04:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:43 user nova-compute[71516]: DEBUG nova.compute.manager [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:04:43 user nova-compute[71516]: DEBUG nova.compute.manager [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:04:43 user nova-compute[71516]: DEBUG nova.network.neutron [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:04:43 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:04:43 user nova-compute[71516]: DEBUG nova.compute.manager [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:04:43 user nova-compute[71516]: DEBUG nova.compute.manager [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:04:43 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:04:43 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Creating image(s)
Apr 11 23:04:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "/opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "/opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "/opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4.part --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG nova.policy [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '859ae6c19707455ebf82bf532c9e10c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3e11fd040149dd8f5a130a9682a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4.part --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG nova.virt.images [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a was qcow2, converting to raw {{(pid=71516) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4.part /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4.converted {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4.part /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4.converted" returned: 0 in 0.145s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4.converted --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4.converted --force-share --output=json" returned: 0 in 0.128s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.773s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:44 user nova-compute[71516]: INFO oslo.privsep.daemon [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1k5abq4p/privsep.sock']
Apr 11 23:04:44 user sudo[80237]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1k5abq4p/privsep.sock
Apr 11 23:04:44 user sudo[80237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 23:04:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:04:44 user nova-compute[71516]: INFO nova.compute.claims [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Claim successful on node user
Apr 11 23:04:44 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:04:44 user nova-compute[71516]: DEBUG nova.network.neutron [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:04:44 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:04:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:04:45 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:04:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:04:45 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Creating image(s)
Apr 11 23:04:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:45 user nova-compute[71516]: DEBUG nova.policy [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:04:45 user nova-compute[71516]: DEBUG nova.network.neutron [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Successfully created port: d32a4080-99bc-415f-8ab8-27b11a4658b4 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:04:46 user nova-compute[71516]: INFO oslo.privsep.daemon [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Spawned new privsep daemon via rootwrap
Apr 11 23:04:46 user nova-compute[71516]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 23:04:46 user sudo[80237]: pam_unix(sudo:session): session closed for user root
Apr 11 23:04:46 user nova-compute[71516]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 23:04:46 user nova-compute[71516]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 11 23:04:46 user nova-compute[71516]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80240
Apr 11 23:04:46 user nova-compute[71516]: WARNING oslo_privsep.priv_context [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] privsep daemon already running
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.148s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.149s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.166s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk 1073741824" returned: 0 in 0.045s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.215s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.118s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.190s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk 1073741824" returned: 0 in 0.040s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Cannot resize image /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG nova.objects.instance [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'migration_context' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Ensure instance console log exists: /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:04:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Cannot resize image /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.objects.instance [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lazy-loading 'migration_context' on Instance uuid ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Ensure instance console log exists: /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "4f95b120-0c70-45a5-969f-c1728c72d420" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:04:47 user nova-compute[71516]: INFO nova.compute.claims [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Claim successful on node user
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.network.neutron [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Successfully created port: 961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.network.neutron [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Successfully updated port: d32a4080-99bc-415f-8ab8-27b11a4658b4 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "refresh_cache-ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquired lock "refresh_cache-ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.network.neutron [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.277s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.network.neutron [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:04:47 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.network.neutron [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.compute.manager [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Received event network-changed-d32a4080-99bc-415f-8ab8-27b11a4658b4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.compute.manager [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Refreshing instance network info cache due to event network-changed-d32a4080-99bc-415f-8ab8-27b11a4658b4. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] Acquiring lock "refresh_cache-ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:04:47 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Creating image(s)
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "/opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "/opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG nova.policy [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9e926b3053c4258a3340d19ae40a7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8550fae43fa54d9a99dedf1d8e3bf0d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.145s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk 1073741824" returned: 0 in 0.042s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Cannot resize image /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.objects.instance [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'migration_context' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Ensure instance console log exists: /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.network.neutron [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Updating instance_info_cache with network_info: [{"id": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "address": "fa:16:3e:28:ea:b9", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32a4080-99", "ovs_interfaceid": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Releasing lock "refresh_cache-ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Instance network_info: |[{"id": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "address": "fa:16:3e:28:ea:b9", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32a4080-99", "ovs_interfaceid": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] Acquired lock "refresh_cache-ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.network.neutron [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Refreshing network info cache for port d32a4080-99bc-415f-8ab8-27b11a4658b4 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Start _get_guest_xml network_info=[{"id": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "address": "fa:16:3e:28:ea:b9", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32a4080-99", "ovs_interfaceid": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:04:48 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:04:48 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1843582430',display_name='tempest-ServersNegativeTestJSON-server-1843582430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1843582430',id=1,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c3e11fd040149dd8f5a130a9682a59c',ramdisk_id='',reservation_id='r-bz0bw7l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1318055293',owner_user_name='tempest-ServersNegativeTestJSON-1318055293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:04:43Z,user_data=None,user_id='859ae6c19707455ebf82bf532c9e10c0',uuid=ede8a4b9-1d26-4090-a968-a90bdd5fc2c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "address": "fa:16:3e:28:ea:b9", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32a4080-99", "ovs_interfaceid": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Converting VIF {"id": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "address": "fa:16:3e:28:ea:b9", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32a4080-99", "ovs_interfaceid": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=d32a4080-99bc-415f-8ab8-27b11a4658b4,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32a4080-99') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.objects.instance [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lazy-loading 'pci_devices' on Instance uuid ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:04:48 user nova-compute[71516]:   <uuid>ede8a4b9-1d26-4090-a968-a90bdd5fc2c9</uuid>
Apr 11 23:04:48 user nova-compute[71516]:   <name>instance-00000001</name>
Apr 11 23:04:48 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:04:48 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:04:48 user nova-compute[71516]:   <metadata>
Apr 11 23:04:48 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:04:48 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:04:48 user nova-compute[71516]:       <nova:name>tempest-ServersNegativeTestJSON-server-1843582430</nova:name>
Apr 11 23:04:48 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:04:48</nova:creationTime>
Apr 11 23:04:48 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:04:48 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:04:48 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:04:48 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:04:48 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:04:48 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:04:48 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:04:48 user nova-compute[71516]:       <nova:owner>
Apr 11 23:04:48 user nova-compute[71516]:         <nova:user uuid="859ae6c19707455ebf82bf532c9e10c0">tempest-ServersNegativeTestJSON-1318055293-project-member</nova:user>
Apr 11 23:04:48 user nova-compute[71516]:         <nova:project uuid="4c3e11fd040149dd8f5a130a9682a59c">tempest-ServersNegativeTestJSON-1318055293</nova:project>
Apr 11 23:04:48 user nova-compute[71516]:       </nova:owner>
Apr 11 23:04:48 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:04:48 user nova-compute[71516]:       <nova:ports>
Apr 11 23:04:48 user nova-compute[71516]:         <nova:port uuid="d32a4080-99bc-415f-8ab8-27b11a4658b4">
Apr 11 23:04:48 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 23:04:48 user nova-compute[71516]:         </nova:port>
Apr 11 23:04:48 user nova-compute[71516]:       </nova:ports>
Apr 11 23:04:48 user nova-compute[71516]:     </nova:instance>
Apr 11 23:04:48 user nova-compute[71516]:   </metadata>
Apr 11 23:04:48 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:04:48 user nova-compute[71516]:     <system>
Apr 11 23:04:48 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:04:48 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:04:48 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:04:48 user nova-compute[71516]:       <entry name="serial">ede8a4b9-1d26-4090-a968-a90bdd5fc2c9</entry>
Apr 11 23:04:48 user nova-compute[71516]:       <entry name="uuid">ede8a4b9-1d26-4090-a968-a90bdd5fc2c9</entry>
Apr 11 23:04:48 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:04:48 user nova-compute[71516]:     </system>
Apr 11 23:04:48 user nova-compute[71516]:   </sysinfo>
Apr 11 23:04:48 user nova-compute[71516]:   <os>
Apr 11 23:04:48 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:04:48 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:04:48 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:04:48 user nova-compute[71516]:   </os>
Apr 11 23:04:48 user nova-compute[71516]:   <features>
Apr 11 23:04:48 user nova-compute[71516]:     <acpi/>
Apr 11 23:04:48 user nova-compute[71516]:     <apic/>
Apr 11 23:04:48 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:04:48 user nova-compute[71516]:   </features>
Apr 11 23:04:48 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:04:48 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:04:48 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:04:48 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:04:48 user nova-compute[71516]:   </clock>
Apr 11 23:04:48 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:04:48 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:04:48 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:04:48 user nova-compute[71516]:   </cpu>
Apr 11 23:04:48 user nova-compute[71516]:   <devices>
Apr 11 23:04:48 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:04:48 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:04:48 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk"/>
Apr 11 23:04:48 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:04:48 user nova-compute[71516]:     </disk>
Apr 11 23:04:48 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:04:48 user nova-compute[71516]:       <mac address="fa:16:3e:28:ea:b9"/>
Apr 11 23:04:48 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:04:48 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:04:48 user nova-compute[71516]:       <target dev="tapd32a4080-99"/>
Apr 11 23:04:48 user nova-compute[71516]:     </interface>
Apr 11 23:04:48 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:04:48 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/console.log" append="off"/>
Apr 11 23:04:48 user nova-compute[71516]:     </serial>
Apr 11 23:04:48 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:04:48 user nova-compute[71516]:     <video>
Apr 11 23:04:48 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:04:48 user nova-compute[71516]:     </video>
Apr 11 23:04:48 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:04:48 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:04:48 user nova-compute[71516]:     </rng>
Apr 11 23:04:48 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:04:48 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:04:48 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:04:48 user nova-compute[71516]:     </memballoon>
Apr 11 23:04:48 user nova-compute[71516]:   </devices>
Apr 11 23:04:48 user nova-compute[71516]: </domain>
Apr 11 23:04:48 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1843582430',display_name='tempest-ServersNegativeTestJSON-server-1843582430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1843582430',id=1,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c3e11fd040149dd8f5a130a9682a59c',ramdisk_id='',reservation_id='r-bz0bw7l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1318055293',owner_user_name='tempest-ServersNegativeTestJSON-1318055293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:04:43Z,user_data=None,user_id='859ae6c19707455ebf82bf532c9e10c0',uuid=ede8a4b9-1d26-4090-a968-a90bdd5fc2c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "address": "fa:16:3e:28:ea:b9", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32a4080-99", "ovs_interfaceid": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Converting VIF {"id": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "address": "fa:16:3e:28:ea:b9", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32a4080-99", "ovs_interfaceid": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=d32a4080-99bc-415f-8ab8-27b11a4658b4,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32a4080-99') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG os_vif [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=d32a4080-99bc-415f-8ab8-27b11a4658b4,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32a4080-99') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Created schema index Interface.name {{(pid=71516) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Created schema index Port.name {{(pid=71516) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Created schema index Bridge.name {{(pid=71516) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [POLLOUT] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:04:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:04:48 user nova-compute[71516]: INFO oslo.privsep.daemon [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp10ojmov5/privsep.sock']
Apr 11 23:04:48 user sudo[80331]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp10ojmov5/privsep.sock
Apr 11 23:04:48 user sudo[80331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 23:04:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:49 user nova-compute[71516]: DEBUG nova.network.neutron [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Successfully updated port: 961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:04:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:04:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquired lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:04:50 user nova-compute[71516]: DEBUG nova.network.neutron [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:04:50 user nova-compute[71516]: DEBUG nova.network.neutron [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:04:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-changed-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:04:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Refreshing instance network info cache due to event network-changed-961d8195-c0d7-49eb-bfd7-05ee4b3e6112. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:04:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] Acquiring lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:04:50 user nova-compute[71516]: DEBUG nova.network.neutron [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Updated VIF entry in instance network info cache for port d32a4080-99bc-415f-8ab8-27b11a4658b4. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:04:50 user nova-compute[71516]: DEBUG nova.network.neutron [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Updating instance_info_cache with network_info: [{"id": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "address": "fa:16:3e:28:ea:b9", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32a4080-99", "ovs_interfaceid": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:04:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] Releasing lock "refresh_cache-ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:04:50 user sudo[80331]: pam_unix(sudo:session): session closed for user root
Apr 11 23:04:50 user nova-compute[71516]: INFO oslo.privsep.daemon [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Spawned new privsep daemon via rootwrap
Apr 11 23:04:50 user nova-compute[71516]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 23:04:50 user nova-compute[71516]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 23:04:50 user nova-compute[71516]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 11 23:04:50 user nova-compute[71516]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80337
Apr 11 23:04:50 user nova-compute[71516]: DEBUG nova.network.neutron [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Successfully created port: 7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd32a4080-99, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd32a4080-99, col_values=(('external_ids', {'iface-id': 'd32a4080-99bc-415f-8ab8-27b11a4658b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:ea:b9', 'vm-uuid': 'ede8a4b9-1d26-4090-a968-a90bdd5fc2c9'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:51 user nova-compute[71516]: INFO os_vif [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=d32a4080-99bc-415f-8ab8-27b11a4658b4,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32a4080-99')
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] No VIF found with MAC fa:16:3e:28:ea:b9, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.network.neutron [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating instance_info_cache with network_info: [{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Releasing lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance network_info: |[{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] Acquired lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.network.neutron [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Refreshing network info cache for port 961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Start _get_guest_xml network_info=[{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:04:51 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:04:51 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1831107086',display_name='tempest-ServerActionsTestJSON-server-1831107086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1831107086',id=2,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-pn29cvap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=eed8cea5-9e5c-4467-8993-456cb3235fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.objects.instance [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'pci_devices' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:04:51 user nova-compute[71516]:   <uuid>eed8cea5-9e5c-4467-8993-456cb3235fd8</uuid>
Apr 11 23:04:51 user nova-compute[71516]:   <name>instance-00000002</name>
Apr 11 23:04:51 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:04:51 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:04:51 user nova-compute[71516]:   <metadata>
Apr 11 23:04:51 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:04:51 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:04:51 user nova-compute[71516]:       <nova:name>tempest-ServerActionsTestJSON-server-1831107086</nova:name>
Apr 11 23:04:51 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:04:51</nova:creationTime>
Apr 11 23:04:51 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:04:51 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:04:51 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:04:51 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:04:51 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:04:51 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:04:51 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:04:51 user nova-compute[71516]:       <nova:owner>
Apr 11 23:04:51 user nova-compute[71516]:         <nova:user uuid="ddc7eb14e7174babb8680b4020243c97">tempest-ServerActionsTestJSON-813592275-project-member</nova:user>
Apr 11 23:04:51 user nova-compute[71516]:         <nova:project uuid="2fca37343b414de6b008ad79e022f858">tempest-ServerActionsTestJSON-813592275</nova:project>
Apr 11 23:04:51 user nova-compute[71516]:       </nova:owner>
Apr 11 23:04:51 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:04:51 user nova-compute[71516]:       <nova:ports>
Apr 11 23:04:51 user nova-compute[71516]:         <nova:port uuid="961d8195-c0d7-49eb-bfd7-05ee4b3e6112">
Apr 11 23:04:51 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:04:51 user nova-compute[71516]:         </nova:port>
Apr 11 23:04:51 user nova-compute[71516]:       </nova:ports>
Apr 11 23:04:51 user nova-compute[71516]:     </nova:instance>
Apr 11 23:04:51 user nova-compute[71516]:   </metadata>
Apr 11 23:04:51 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:04:51 user nova-compute[71516]:     <system>
Apr 11 23:04:51 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:04:51 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:04:51 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:04:51 user nova-compute[71516]:       <entry name="serial">eed8cea5-9e5c-4467-8993-456cb3235fd8</entry>
Apr 11 23:04:51 user nova-compute[71516]:       <entry name="uuid">eed8cea5-9e5c-4467-8993-456cb3235fd8</entry>
Apr 11 23:04:51 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:04:51 user nova-compute[71516]:     </system>
Apr 11 23:04:51 user nova-compute[71516]:   </sysinfo>
Apr 11 23:04:51 user nova-compute[71516]:   <os>
Apr 11 23:04:51 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:04:51 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:04:51 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:04:51 user nova-compute[71516]:   </os>
Apr 11 23:04:51 user nova-compute[71516]:   <features>
Apr 11 23:04:51 user nova-compute[71516]:     <acpi/>
Apr 11 23:04:51 user nova-compute[71516]:     <apic/>
Apr 11 23:04:51 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:04:51 user nova-compute[71516]:   </features>
Apr 11 23:04:51 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:04:51 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:04:51 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:04:51 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:04:51 user nova-compute[71516]:   </clock>
Apr 11 23:04:51 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:04:51 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:04:51 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:04:51 user nova-compute[71516]:   </cpu>
Apr 11 23:04:51 user nova-compute[71516]:   <devices>
Apr 11 23:04:51 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:04:51 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:04:51 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk"/>
Apr 11 23:04:51 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:04:51 user nova-compute[71516]:     </disk>
Apr 11 23:04:51 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:04:51 user nova-compute[71516]:       <mac address="fa:16:3e:ec:10:5e"/>
Apr 11 23:04:51 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:04:51 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:04:51 user nova-compute[71516]:       <target dev="tap961d8195-c0"/>
Apr 11 23:04:51 user nova-compute[71516]:     </interface>
Apr 11 23:04:51 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:04:51 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/console.log" append="off"/>
Apr 11 23:04:51 user nova-compute[71516]:     </serial>
Apr 11 23:04:51 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:04:51 user nova-compute[71516]:     <video>
Apr 11 23:04:51 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:04:51 user nova-compute[71516]:     </video>
Apr 11 23:04:51 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:04:51 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:04:51 user nova-compute[71516]:     </rng>
Apr 11 23:04:51 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:04:51 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:04:51 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:04:51 user nova-compute[71516]:     </memballoon>
Apr 11 23:04:51 user nova-compute[71516]:   </devices>
Apr 11 23:04:51 user nova-compute[71516]: </domain>
Apr 11 23:04:51 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1831107086',display_name='tempest-ServerActionsTestJSON-server-1831107086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1831107086',id=2,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-pn29cvap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=eed8cea5-9e5c-4467-8993-456cb3235fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG os_vif [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap961d8195-c0, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap961d8195-c0, col_values=(('external_ids', {'iface-id': '961d8195-c0d7-49eb-bfd7-05ee4b3e6112', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:10:5e', 'vm-uuid': 'eed8cea5-9e5c-4467-8993-456cb3235fd8'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:51 user nova-compute[71516]: INFO os_vif [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0')
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No VIF found with MAC fa:16:3e:ec:10:5e, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:52 user nova-compute[71516]: DEBUG nova.network.neutron [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updated VIF entry in instance network info cache for port 961d8195-c0d7-49eb-bfd7-05ee4b3e6112. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:04:52 user nova-compute[71516]: DEBUG nova.network.neutron [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating instance_info_cache with network_info: [{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:04:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] Releasing lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Successfully updated port: 7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquired lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-changed-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Refreshing instance network info cache due to event network-changed-7a130357-a93e-4aad-8404-d4b5b8dd7022. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] Acquiring lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "8322b884-2831-48af-a67e-26c31c17f49f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updating instance_info_cache with network_info: [{"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Releasing lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Instance network_info: |[{"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] Acquired lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Refreshing network info cache for port 7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Start _get_guest_xml network_info=[{"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:04:53 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:04:53 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:04:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-229868185',display_name='tempest-ServerStableDeviceRescueTest-server-229868185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-229868185',id=3,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE9QDWoeyAk5NPp++qY0mw94h70wgQ85QXWkrvjtaSwwpbB/vlw81NpI+lMUuo71+oPbM1g+FT373UgIfaZ8VyRJDzOgtgdrI0cP+MdyqWrhTvd1yMzfPZXk/mcG9NWEw==',key_name='tempest-keypair-24963563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8550fae43fa54d9a99dedf1d8e3bf0d0',ramdisk_id='',reservation_id='r-wtsmu0zf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2037080891',owner_user_name='tempest-ServerStableDeviceRescueTest-2037080891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:04:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9e926b3053c4258a3340d19ae40a7a9',uuid=4f95b120-0c70-45a5-969f-c1728c72d420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Converting VIF {"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:ca:37,bridge_name='br-int',has_traffic_filtering=True,id=7a130357-a93e-4aad-8404-d4b5b8dd7022,network=Network(a4b59436-3706-4c0a-97c0-b11230ce2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a130357-a9') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.objects.instance [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:04:53 user nova-compute[71516]: INFO nova.compute.claims [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Claim successful on node user
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:04:53 user nova-compute[71516]:   <uuid>4f95b120-0c70-45a5-969f-c1728c72d420</uuid>
Apr 11 23:04:53 user nova-compute[71516]:   <name>instance-00000003</name>
Apr 11 23:04:53 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:04:53 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:04:53 user nova-compute[71516]:   <metadata>
Apr 11 23:04:53 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:04:53 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:04:53 user nova-compute[71516]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-229868185</nova:name>
Apr 11 23:04:53 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:04:53</nova:creationTime>
Apr 11 23:04:53 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:04:53 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:04:53 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:04:53 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:04:53 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:04:53 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:04:53 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:04:53 user nova-compute[71516]:       <nova:owner>
Apr 11 23:04:53 user nova-compute[71516]:         <nova:user uuid="e9e926b3053c4258a3340d19ae40a7a9">tempest-ServerStableDeviceRescueTest-2037080891-project-member</nova:user>
Apr 11 23:04:53 user nova-compute[71516]:         <nova:project uuid="8550fae43fa54d9a99dedf1d8e3bf0d0">tempest-ServerStableDeviceRescueTest-2037080891</nova:project>
Apr 11 23:04:53 user nova-compute[71516]:       </nova:owner>
Apr 11 23:04:53 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:04:53 user nova-compute[71516]:       <nova:ports>
Apr 11 23:04:53 user nova-compute[71516]:         <nova:port uuid="7a130357-a93e-4aad-8404-d4b5b8dd7022">
Apr 11 23:04:53 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 23:04:53 user nova-compute[71516]:         </nova:port>
Apr 11 23:04:53 user nova-compute[71516]:       </nova:ports>
Apr 11 23:04:53 user nova-compute[71516]:     </nova:instance>
Apr 11 23:04:53 user nova-compute[71516]:   </metadata>
Apr 11 23:04:53 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:04:53 user nova-compute[71516]:     <system>
Apr 11 23:04:53 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:04:53 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:04:53 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:04:53 user nova-compute[71516]:       <entry name="serial">4f95b120-0c70-45a5-969f-c1728c72d420</entry>
Apr 11 23:04:53 user nova-compute[71516]:       <entry name="uuid">4f95b120-0c70-45a5-969f-c1728c72d420</entry>
Apr 11 23:04:53 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:04:53 user nova-compute[71516]:     </system>
Apr 11 23:04:53 user nova-compute[71516]:   </sysinfo>
Apr 11 23:04:53 user nova-compute[71516]:   <os>
Apr 11 23:04:53 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:04:53 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:04:53 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:04:53 user nova-compute[71516]:   </os>
Apr 11 23:04:53 user nova-compute[71516]:   <features>
Apr 11 23:04:53 user nova-compute[71516]:     <acpi/>
Apr 11 23:04:53 user nova-compute[71516]:     <apic/>
Apr 11 23:04:53 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:04:53 user nova-compute[71516]:   </features>
Apr 11 23:04:53 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:04:53 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:04:53 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:04:53 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:04:53 user nova-compute[71516]:   </clock>
Apr 11 23:04:53 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:04:53 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:04:53 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:04:53 user nova-compute[71516]:   </cpu>
Apr 11 23:04:53 user nova-compute[71516]:   <devices>
Apr 11 23:04:53 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:04:53 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:04:53 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk"/>
Apr 11 23:04:53 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:04:53 user nova-compute[71516]:     </disk>
Apr 11 23:04:53 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:04:53 user nova-compute[71516]:       <mac address="fa:16:3e:24:ca:37"/>
Apr 11 23:04:53 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:04:53 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:04:53 user nova-compute[71516]:       <target dev="tap7a130357-a9"/>
Apr 11 23:04:53 user nova-compute[71516]:     </interface>
Apr 11 23:04:53 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:04:53 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/console.log" append="off"/>
Apr 11 23:04:53 user nova-compute[71516]:     </serial>
Apr 11 23:04:53 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:04:53 user nova-compute[71516]:     <video>
Apr 11 23:04:53 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:04:53 user nova-compute[71516]:     </video>
Apr 11 23:04:53 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:04:53 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:04:53 user nova-compute[71516]:     </rng>
Apr 11 23:04:53 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:04:53 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:04:53 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:04:53 user nova-compute[71516]:     </memballoon>
Apr 11 23:04:53 user nova-compute[71516]:   </devices>
Apr 11 23:04:53 user nova-compute[71516]: </domain>
Apr 11 23:04:53 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:04:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-229868185',display_name='tempest-ServerStableDeviceRescueTest-server-229868185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-229868185',id=3,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE9QDWoeyAk5NPp++qY0mw94h70wgQ85QXWkrvjtaSwwpbB/vlw81NpI+lMUuo71+oPbM1g+FT373UgIfaZ8VyRJDzOgtgdrI0cP+MdyqWrhTvd1yMzfPZXk/mcG9NWEw==',key_name='tempest-keypair-24963563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8550fae43fa54d9a99dedf1d8e3bf0d0',ramdisk_id='',reservation_id='r-wtsmu0zf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2037080891',owner_user_name='tempest-ServerStableDeviceRescueTest-2037080891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:04:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9e926b3053c4258a3340d19ae40a7a9',uuid=4f95b120-0c70-45a5-969f-c1728c72d420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Converting VIF {"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:ca:37,bridge_name='br-int',has_traffic_filtering=True,id=7a130357-a93e-4aad-8404-d4b5b8dd7022,network=Network(a4b59436-3706-4c0a-97c0-b11230ce2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a130357-a9') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG os_vif [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:ca:37,bridge_name='br-int',has_traffic_filtering=True,id=7a130357-a93e-4aad-8404-d4b5b8dd7022,network=Network(a4b59436-3706-4c0a-97c0-b11230ce2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a130357-a9') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a130357-a9, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a130357-a9, col_values=(('external_ids', {'iface-id': '7a130357-a93e-4aad-8404-d4b5b8dd7022', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:ca:37', 'vm-uuid': '4f95b120-0c70-45a5-969f-c1728c72d420'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:53 user nova-compute[71516]: INFO os_vif [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:ca:37,bridge_name='br-int',has_traffic_filtering=True,id=7a130357-a93e-4aad-8404-d4b5b8dd7022,network=Network(a4b59436-3706-4c0a-97c0-b11230ce2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a130357-a9')
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:04:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] No VIF found with MAC fa:16:3e:24:ca:37, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:04:54 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:04:54 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-6689c85f-40f3-453f-a9ff-f3bfc368ec60 req-8d253801-a4f1-428f-8b11-c0ab9201156e service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Received event network-vif-plugged-d32a4080-99bc-415f-8ab8-27b11a4658b4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6689c85f-40f3-453f-a9ff-f3bfc368ec60 req-8d253801-a4f1-428f-8b11-c0ab9201156e service nova] Acquiring lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6689c85f-40f3-453f-a9ff-f3bfc368ec60 req-8d253801-a4f1-428f-8b11-c0ab9201156e service nova] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6689c85f-40f3-453f-a9ff-f3bfc368ec60 req-8d253801-a4f1-428f-8b11-c0ab9201156e service nova] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-6689c85f-40f3-453f-a9ff-f3bfc368ec60 req-8d253801-a4f1-428f-8b11-c0ab9201156e service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] No waiting events found dispatching network-vif-plugged-d32a4080-99bc-415f-8ab8-27b11a4658b4 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:04:54 user nova-compute[71516]: WARNING nova.compute.manager [req-6689c85f-40f3-453f-a9ff-f3bfc368ec60 req-8d253801-a4f1-428f-8b11-c0ab9201156e service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Received unexpected event network-vif-plugged-d32a4080-99bc-415f-8ab8-27b11a4658b4 for instance with vm_state building and task_state spawning.
Apr 11 23:04:54 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:04:54 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Creating image(s)
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "/opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "/opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "/opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG nova.policy [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG nova.network.neutron [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updated VIF entry in instance network info cache for port 7a130357-a93e-4aad-8404-d4b5b8dd7022. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG nova.network.neutron [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updating instance_info_cache with network_info: [{"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.160s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] Releasing lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.128s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk 1073741824" returned: 0 in 0.054s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-0e6037c2-43ec-490d-9968-e00fbb2bcf17 req-2ca3ca11-c492-44a1-8f7e-731f0f25a439 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0e6037c2-43ec-490d-9968-e00fbb2bcf17 req-2ca3ca11-c492-44a1-8f7e-731f0f25a439 service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0e6037c2-43ec-490d-9968-e00fbb2bcf17 req-2ca3ca11-c492-44a1-8f7e-731f0f25a439 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0e6037c2-43ec-490d-9968-e00fbb2bcf17 req-2ca3ca11-c492-44a1-8f7e-731f0f25a439 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-0e6037c2-43ec-490d-9968-e00fbb2bcf17 req-2ca3ca11-c492-44a1-8f7e-731f0f25a439 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:04:55 user nova-compute[71516]: WARNING nova.compute.manager [req-0e6037c2-43ec-490d-9968-e00fbb2bcf17 req-2ca3ca11-c492-44a1-8f7e-731f0f25a439 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state building and task_state spawning.
Apr 11 23:04:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Cannot resize image /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG nova.objects.instance [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'migration_context' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Ensure instance console log exists: /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Successfully created port: b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-717f28e2-1d1b-48fc-b228-ca316efc554f req-6abf79f2-765e-4252-bd34-746340d3f431 service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Received event network-vif-plugged-d32a4080-99bc-415f-8ab8-27b11a4658b4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-717f28e2-1d1b-48fc-b228-ca316efc554f req-6abf79f2-765e-4252-bd34-746340d3f431 service nova] Acquiring lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-717f28e2-1d1b-48fc-b228-ca316efc554f req-6abf79f2-765e-4252-bd34-746340d3f431 service nova] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-717f28e2-1d1b-48fc-b228-ca316efc554f req-6abf79f2-765e-4252-bd34-746340d3f431 service nova] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-717f28e2-1d1b-48fc-b228-ca316efc554f req-6abf79f2-765e-4252-bd34-746340d3f431 service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] No waiting events found dispatching network-vif-plugged-d32a4080-99bc-415f-8ab8-27b11a4658b4 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:04:56 user nova-compute[71516]: WARNING nova.compute.manager [req-717f28e2-1d1b-48fc-b228-ca316efc554f req-6abf79f2-765e-4252-bd34-746340d3f431 service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Received unexpected event network-vif-plugged-d32a4080-99bc-415f-8ab8-27b11a4658b4 for instance with vm_state building and task_state spawning.
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254296.8274326, eed8cea5-9e5c-4467-8993-456cb3235fd8 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:04:56 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] VM Resumed (Lifecycle Event)
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:04:56 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance spawned successfully.
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:04:56 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:04:57 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254296.8280911, eed8cea5-9e5c-4467-8993-456cb3235fd8 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:04:57 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] VM Started (Lifecycle Event)
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:04:57 user nova-compute[71516]: INFO nova.compute.manager [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Took 12.05 seconds to spawn the instance on the hypervisor.
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-a189057d-c371-4111-abc2-1c1b6a5ba8bd req-59f39bf8-3a90-48d1-9c04-94e738aa38ea service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a189057d-c371-4111-abc2-1c1b6a5ba8bd req-59f39bf8-3a90-48d1-9c04-94e738aa38ea service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a189057d-c371-4111-abc2-1c1b6a5ba8bd req-59f39bf8-3a90-48d1-9c04-94e738aa38ea service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a189057d-c371-4111-abc2-1c1b6a5ba8bd req-59f39bf8-3a90-48d1-9c04-94e738aa38ea service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-a189057d-c371-4111-abc2-1c1b6a5ba8bd req-59f39bf8-3a90-48d1-9c04-94e738aa38ea service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:04:57 user nova-compute[71516]: WARNING nova.compute.manager [req-a189057d-c371-4111-abc2-1c1b6a5ba8bd req-59f39bf8-3a90-48d1-9c04-94e738aa38ea service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state building and task_state spawning.
Apr 11 23:04:57 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:04:57 user nova-compute[71516]: INFO nova.compute.manager [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Took 12.88 seconds to build instance.
Apr 11 23:04:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.056s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Successfully updated port: b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquired lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254297.4534578, ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:04:57 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] VM Resumed (Lifecycle Event)
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.compute.manager [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-changed-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Refreshing instance network info cache due to event network-changed-b44a27e4-9811-4e81-8f41-c7f58def46bc. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] Acquiring lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:04:57 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Instance spawned successfully.
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:57 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254297.45563, ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:04:57 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] VM Started (Lifecycle Event)
Apr 11 23:04:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:04:57 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:04:57 user nova-compute[71516]: INFO nova.compute.manager [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Took 14.04 seconds to spawn the instance on the hypervisor.
Apr 11 23:04:57 user nova-compute[71516]: DEBUG nova.compute.manager [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:04:57 user nova-compute[71516]: INFO nova.compute.manager [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Took 14.94 seconds to build instance.
Apr 11 23:04:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.208s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updating instance_info_cache with network_info: [{"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Releasing lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Instance network_info: |[{"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] Acquired lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.network.neutron [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Refreshing network info cache for port b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Start _get_guest_xml network_info=[{"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:04:58 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:04:58 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-742046125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-742046125',id=4,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhq2c1AASfEGyAAJl+QIGDBVlGaQd5aU2DpuWVUMd+VgtFnNGA30jaPJqm7CxuxKNS3cfyVDWuM5n3h/I+Opv2IF/BYKVBsSYfscd1VrAJJc1HvdHk6jRHnOOCv9avuqQ==',key_name='tempest-keypair-208393987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b466a7e141a247319eae64ab30aca760',ramdisk_id='',reservation_id='r-kxb0ie0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849897654',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849897654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:04:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7272af33be864737b2231127f4323638',uuid=8322b884-2831-48af-a67e-26c31c17f49f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converting VIF {"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.objects.instance [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'pci_devices' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254298.4161024, 4f95b120-0c70-45a5-969f-c1728c72d420 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:04:58 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] VM Resumed (Lifecycle Event)
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:04:58 user nova-compute[71516]:   <uuid>8322b884-2831-48af-a67e-26c31c17f49f</uuid>
Apr 11 23:04:58 user nova-compute[71516]:   <name>instance-00000004</name>
Apr 11 23:04:58 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:04:58 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:04:58 user nova-compute[71516]:   <metadata>
Apr 11 23:04:58 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:04:58 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:04:58 user nova-compute[71516]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-742046125</nova:name>
Apr 11 23:04:58 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:04:58</nova:creationTime>
Apr 11 23:04:58 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:04:58 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:04:58 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:04:58 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:04:58 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:04:58 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:04:58 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:04:58 user nova-compute[71516]:       <nova:owner>
Apr 11 23:04:58 user nova-compute[71516]:         <nova:user uuid="7272af33be864737b2231127f4323638">tempest-AttachVolumeShelveTestJSON-1849897654-project-member</nova:user>
Apr 11 23:04:58 user nova-compute[71516]:         <nova:project uuid="b466a7e141a247319eae64ab30aca760">tempest-AttachVolumeShelveTestJSON-1849897654</nova:project>
Apr 11 23:04:58 user nova-compute[71516]:       </nova:owner>
Apr 11 23:04:58 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:04:58 user nova-compute[71516]:       <nova:ports>
Apr 11 23:04:58 user nova-compute[71516]:         <nova:port uuid="b44a27e4-9811-4e81-8f41-c7f58def46bc">
Apr 11 23:04:58 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:04:58 user nova-compute[71516]:         </nova:port>
Apr 11 23:04:58 user nova-compute[71516]:       </nova:ports>
Apr 11 23:04:58 user nova-compute[71516]:     </nova:instance>
Apr 11 23:04:58 user nova-compute[71516]:   </metadata>
Apr 11 23:04:58 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:04:58 user nova-compute[71516]:     <system>
Apr 11 23:04:58 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:04:58 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:04:58 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:04:58 user nova-compute[71516]:       <entry name="serial">8322b884-2831-48af-a67e-26c31c17f49f</entry>
Apr 11 23:04:58 user nova-compute[71516]:       <entry name="uuid">8322b884-2831-48af-a67e-26c31c17f49f</entry>
Apr 11 23:04:58 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:04:58 user nova-compute[71516]:     </system>
Apr 11 23:04:58 user nova-compute[71516]:   </sysinfo>
Apr 11 23:04:58 user nova-compute[71516]:   <os>
Apr 11 23:04:58 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:04:58 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:04:58 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:04:58 user nova-compute[71516]:   </os>
Apr 11 23:04:58 user nova-compute[71516]:   <features>
Apr 11 23:04:58 user nova-compute[71516]:     <acpi/>
Apr 11 23:04:58 user nova-compute[71516]:     <apic/>
Apr 11 23:04:58 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:04:58 user nova-compute[71516]:   </features>
Apr 11 23:04:58 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:04:58 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:04:58 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:04:58 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:04:58 user nova-compute[71516]:   </clock>
Apr 11 23:04:58 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:04:58 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:04:58 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:04:58 user nova-compute[71516]:   </cpu>
Apr 11 23:04:58 user nova-compute[71516]:   <devices>
Apr 11 23:04:58 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:04:58 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:04:58 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk"/>
Apr 11 23:04:58 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:04:58 user nova-compute[71516]:     </disk>
Apr 11 23:04:58 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:04:58 user nova-compute[71516]:       <mac address="fa:16:3e:6a:ca:ec"/>
Apr 11 23:04:58 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:04:58 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:04:58 user nova-compute[71516]:       <target dev="tapb44a27e4-98"/>
Apr 11 23:04:58 user nova-compute[71516]:     </interface>
Apr 11 23:04:58 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:04:58 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/console.log" append="off"/>
Apr 11 23:04:58 user nova-compute[71516]:     </serial>
Apr 11 23:04:58 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:04:58 user nova-compute[71516]:     <video>
Apr 11 23:04:58 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:04:58 user nova-compute[71516]:     </video>
Apr 11 23:04:58 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:04:58 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:04:58 user nova-compute[71516]:     </rng>
Apr 11 23:04:58 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:04:58 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:04:58 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:04:58 user nova-compute[71516]:     </memballoon>
Apr 11 23:04:58 user nova-compute[71516]:   </devices>
Apr 11 23:04:58 user nova-compute[71516]: </domain>
Apr 11 23:04:58 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-742046125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-742046125',id=4,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhq2c1AASfEGyAAJl+QIGDBVlGaQd5aU2DpuWVUMd+VgtFnNGA30jaPJqm7CxuxKNS3cfyVDWuM5n3h/I+Opv2IF/BYKVBsSYfscd1VrAJJc1HvdHk6jRHnOOCv9avuqQ==',key_name='tempest-keypair-208393987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b466a7e141a247319eae64ab30aca760',ramdisk_id='',reservation_id='r-kxb0ie0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849897654',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849897654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:04:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7272af33be864737b2231127f4323638',uuid=8322b884-2831-48af-a67e-26c31c17f49f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converting VIF {"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG os_vif [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb44a27e4-98, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb44a27e4-98, col_values=(('external_ids', {'iface-id': 'b44a27e4-9811-4e81-8f41-c7f58def46bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:ca:ec', 'vm-uuid': '8322b884-2831-48af-a67e-26c31c17f49f'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:04:58 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Instance spawned successfully.
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:58 user nova-compute[71516]: INFO os_vif [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98')
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:04:58 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254298.416195, 4f95b120-0c70-45a5-969f-c1728c72d420 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:04:58 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] VM Started (Lifecycle Event)
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] No VIF found with MAC fa:16:3e:6a:ca:ec, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:04:58 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:04:58 user nova-compute[71516]: INFO nova.compute.manager [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Took 10.87 seconds to spawn the instance on the hypervisor.
Apr 11 23:04:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:04:58 user nova-compute[71516]: INFO nova.compute.manager [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Took 11.65 seconds to build instance.
Apr 11 23:04:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "4f95b120-0c70-45a5-969f-c1728c72d420" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.811s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] No waiting events found dispatching network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:04:59 user nova-compute[71516]: WARNING nova.compute.manager [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received unexpected event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance with vm_state active and task_state None.
Apr 11 23:04:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] No waiting events found dispatching network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:04:59 user nova-compute[71516]: WARNING nova.compute.manager [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received unexpected event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance with vm_state active and task_state None.
Apr 11 23:04:59 user nova-compute[71516]: DEBUG nova.network.neutron [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updated VIF entry in instance network info cache for port b44a27e4-9811-4e81-8f41-c7f58def46bc. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG nova.network.neutron [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updating instance_info_cache with network_info: [{"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] Releasing lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:04:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-502b42f1-f72a-4162-bbba-ebab3defd845 req-f349a22c-8a65-4899-bc48-59734666e94d service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-502b42f1-f72a-4162-bbba-ebab3defd845 req-f349a22c-8a65-4899-bc48-59734666e94d service nova] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-502b42f1-f72a-4162-bbba-ebab3defd845 req-f349a22c-8a65-4899-bc48-59734666e94d service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-502b42f1-f72a-4162-bbba-ebab3defd845 req-f349a22c-8a65-4899-bc48-59734666e94d service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-502b42f1-f72a-4162-bbba-ebab3defd845 req-f349a22c-8a65-4899-bc48-59734666e94d service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] No waiting events found dispatching network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:05:00 user nova-compute[71516]: WARNING nova.compute.manager [req-502b42f1-f72a-4162-bbba-ebab3defd845 req-f349a22c-8a65-4899-bc48-59734666e94d service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received unexpected event network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc for instance with vm_state building and task_state spawning.
Apr 11 23:05:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:05:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:02 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:05:02 user nova-compute[71516]: INFO nova.compute.claims [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Claim successful on node user
Apr 11 23:05:02 user nova-compute[71516]: DEBUG nova.compute.manager [req-c6ec801e-8a39-48f5-8660-c8117f1b6088 req-6a8685b6-d321-4398-9062-22217c56cd17 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c6ec801e-8a39-48f5-8660-c8117f1b6088 req-6a8685b6-d321-4398-9062-22217c56cd17 service nova] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c6ec801e-8a39-48f5-8660-c8117f1b6088 req-6a8685b6-d321-4398-9062-22217c56cd17 service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c6ec801e-8a39-48f5-8660-c8117f1b6088 req-6a8685b6-d321-4398-9062-22217c56cd17 service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:02 user nova-compute[71516]: DEBUG nova.compute.manager [req-c6ec801e-8a39-48f5-8660-c8117f1b6088 req-6a8685b6-d321-4398-9062-22217c56cd17 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] No waiting events found dispatching network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:05:02 user nova-compute[71516]: WARNING nova.compute.manager [req-c6ec801e-8a39-48f5-8660-c8117f1b6088 req-6a8685b6-d321-4398-9062-22217c56cd17 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received unexpected event network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc for instance with vm_state building and task_state spawning.
Apr 11 23:05:02 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:05:02 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254303.1585696, 8322b884-2831-48af-a67e-26c31c17f49f => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:05:03 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] VM Resumed (Lifecycle Event)
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:05:03 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Instance spawned successfully.
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:03 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254303.1659875, 8322b884-2831-48af-a67e-26c31c17f49f => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:05:03 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] VM Started (Lifecycle Event)
Apr 11 23:05:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.006s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:05:03 user nova-compute[71516]: INFO nova.compute.manager [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Took 8.81 seconds to spawn the instance on the hypervisor.
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:03 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:05:03 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:05:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:05:03 user nova-compute[71516]: INFO nova.compute.manager [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Took 9.87 seconds to build instance.
Apr 11 23:05:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "8322b884-2831-48af-a67e-26c31c17f49f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.092s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:05:03 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Creating image(s)
Apr 11 23:05:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "/opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "/opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG nova.policy [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '340848f1de07428e85af2cf660943c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d77b00c084f6f857147717350b6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.180s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.239s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk 1073741824" returned: 0 in 0.106s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.257s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Cannot resize image /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lazy-loading 'migration_context' on Instance uuid fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Ensure instance console log exists: /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:05 user nova-compute[71516]: DEBUG nova.compute.manager [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:05:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:05 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:05:05 user nova-compute[71516]: INFO nova.compute.claims [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Claim successful on node user
Apr 11 23:05:05 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:05:05 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:05:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:05 user nova-compute[71516]: DEBUG nova.compute.manager [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:05:05 user nova-compute[71516]: DEBUG nova.compute.manager [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:05:05 user nova-compute[71516]: DEBUG nova.network.neutron [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:05:05 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:05:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Successfully created port: ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG nova.policy [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9554290c1a944393b68875dbadee5e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204fa09429ce4f2fafbc532805a346bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:05:06 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Creating image(s)
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "/opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "/opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.198s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.206s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk 1073741824" returned: 0 in 0.065s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.160s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:05:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:07 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Cannot resize image /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:05:07 user nova-compute[71516]: DEBUG nova.objects.instance [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lazy-loading 'migration_context' on Instance uuid 5d6517f0-c4f0-4b35-a94a-610058ecc687 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:05:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:05:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Ensure instance console log exists: /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:05:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:07 user nova-compute[71516]: DEBUG nova.network.neutron [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Successfully created port: 37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:07 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Successfully updated port: ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "refresh_cache-fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquired lock "refresh_cache-fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:07 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Received event network-changed-ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Refreshing instance network info cache due to event network-changed-ac411bad-0310-4c20-946a-b95b7b3e3e16. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] Acquiring lock "refresh_cache-fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Updating instance_info_cache with network_info: [{"id": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "address": "fa:16:3e:e1:c0:a4", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac411bad-03", "ovs_interfaceid": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Releasing lock "refresh_cache-fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Instance network_info: |[{"id": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "address": "fa:16:3e:e1:c0:a4", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac411bad-03", "ovs_interfaceid": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] Acquired lock "refresh_cache-fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.network.neutron [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Refreshing network info cache for port ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Start _get_guest_xml network_info=[{"id": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "address": "fa:16:3e:e1:c0:a4", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac411bad-03", "ovs_interfaceid": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:05:08 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:08 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-733558945',display_name='tempest-VolumesAdminNegativeTest-server-733558945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-733558945',id=5,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8ODpXY5bZgmxO5t5Y4E36zk4OtZoXs0KgN3E2IDtgASaVQEDy8SuRh1bds0DVt6hO2bRftrq5qk08LxQJMvdhB80a5j4F6edXn56zcx8okMNhfO4isidv+PZkrEFpPhw==',key_name='tempest-keypair-1401661035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c24d77b00c084f6f857147717350b6e0',ramdisk_id='',reservation_id='r-bpmmsnup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-497834960',owner_user_name='tempest-VolumesAdminNegativeTest-497834960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='340848f1de07428e85af2cf660943c3e',uuid=fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "address": "fa:16:3e:e1:c0:a4", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac411bad-03", "ovs_interfaceid": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Converting VIF {"id": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "address": "fa:16:3e:e1:c0:a4", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac411bad-03", "ovs_interfaceid": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:c0:a4,bridge_name='br-int',has_traffic_filtering=True,id=ac411bad-0310-4c20-946a-b95b7b3e3e16,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac411bad-03') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lazy-loading 'pci_devices' on Instance uuid fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:05:08 user nova-compute[71516]:   <uuid>fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3</uuid>
Apr 11 23:05:08 user nova-compute[71516]:   <name>instance-00000005</name>
Apr 11 23:05:08 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:05:08 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:05:08 user nova-compute[71516]:   <metadata>
Apr 11 23:05:08 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:05:08 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:05:08 user nova-compute[71516]:       <nova:name>tempest-VolumesAdminNegativeTest-server-733558945</nova:name>
Apr 11 23:05:08 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:05:08</nova:creationTime>
Apr 11 23:05:08 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:05:08 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:05:08 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:05:08 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:05:08 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:05:08 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:05:08 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:05:08 user nova-compute[71516]:       <nova:owner>
Apr 11 23:05:08 user nova-compute[71516]:         <nova:user uuid="340848f1de07428e85af2cf660943c3e">tempest-VolumesAdminNegativeTest-497834960-project-member</nova:user>
Apr 11 23:05:08 user nova-compute[71516]:         <nova:project uuid="c24d77b00c084f6f857147717350b6e0">tempest-VolumesAdminNegativeTest-497834960</nova:project>
Apr 11 23:05:08 user nova-compute[71516]:       </nova:owner>
Apr 11 23:05:08 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:05:08 user nova-compute[71516]:       <nova:ports>
Apr 11 23:05:08 user nova-compute[71516]:         <nova:port uuid="ac411bad-0310-4c20-946a-b95b7b3e3e16">
Apr 11 23:05:08 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 23:05:08 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:08 user nova-compute[71516]:       </nova:ports>
Apr 11 23:05:08 user nova-compute[71516]:     </nova:instance>
Apr 11 23:05:08 user nova-compute[71516]:   </metadata>
Apr 11 23:05:08 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:05:08 user nova-compute[71516]:     <system>
Apr 11 23:05:08 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:05:08 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:05:08 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:05:08 user nova-compute[71516]:       <entry name="serial">fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3</entry>
Apr 11 23:05:08 user nova-compute[71516]:       <entry name="uuid">fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3</entry>
Apr 11 23:05:08 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:05:08 user nova-compute[71516]:     </system>
Apr 11 23:05:08 user nova-compute[71516]:   </sysinfo>
Apr 11 23:05:08 user nova-compute[71516]:   <os>
Apr 11 23:05:08 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:05:08 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:05:08 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:05:08 user nova-compute[71516]:   </os>
Apr 11 23:05:08 user nova-compute[71516]:   <features>
Apr 11 23:05:08 user nova-compute[71516]:     <acpi/>
Apr 11 23:05:08 user nova-compute[71516]:     <apic/>
Apr 11 23:05:08 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:05:08 user nova-compute[71516]:   </features>
Apr 11 23:05:08 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:05:08 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:05:08 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:05:08 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:05:08 user nova-compute[71516]:   </clock>
Apr 11 23:05:08 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:05:08 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:05:08 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:05:08 user nova-compute[71516]:   </cpu>
Apr 11 23:05:08 user nova-compute[71516]:   <devices>
Apr 11 23:05:08 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:05:08 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:05:08 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk"/>
Apr 11 23:05:08 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:05:08 user nova-compute[71516]:     </disk>
Apr 11 23:05:08 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:08 user nova-compute[71516]:       <mac address="fa:16:3e:e1:c0:a4"/>
Apr 11 23:05:08 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:08 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:08 user nova-compute[71516]:       <target dev="tapac411bad-03"/>
Apr 11 23:05:08 user nova-compute[71516]:     </interface>
Apr 11 23:05:08 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:05:08 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/console.log" append="off"/>
Apr 11 23:05:08 user nova-compute[71516]:     </serial>
Apr 11 23:05:08 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:05:08 user nova-compute[71516]:     <video>
Apr 11 23:05:08 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:08 user nova-compute[71516]:     </video>
Apr 11 23:05:08 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:05:08 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:05:08 user nova-compute[71516]:     </rng>
Apr 11 23:05:08 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:05:08 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:05:08 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:05:08 user nova-compute[71516]:     </memballoon>
Apr 11 23:05:08 user nova-compute[71516]:   </devices>
Apr 11 23:05:08 user nova-compute[71516]: </domain>
Apr 11 23:05:08 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-733558945',display_name='tempest-VolumesAdminNegativeTest-server-733558945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-733558945',id=5,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8ODpXY5bZgmxO5t5Y4E36zk4OtZoXs0KgN3E2IDtgASaVQEDy8SuRh1bds0DVt6hO2bRftrq5qk08LxQJMvdhB80a5j4F6edXn56zcx8okMNhfO4isidv+PZkrEFpPhw==',key_name='tempest-keypair-1401661035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c24d77b00c084f6f857147717350b6e0',ramdisk_id='',reservation_id='r-bpmmsnup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-497834960',owner_user_name='tempest-VolumesAdminNegativeTest-497834960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='340848f1de07428e85af2cf660943c3e',uuid=fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "address": "fa:16:3e:e1:c0:a4", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac411bad-03", "ovs_interfaceid": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Converting VIF {"id": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "address": "fa:16:3e:e1:c0:a4", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac411bad-03", "ovs_interfaceid": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:c0:a4,bridge_name='br-int',has_traffic_filtering=True,id=ac411bad-0310-4c20-946a-b95b7b3e3e16,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac411bad-03') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG os_vif [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:c0:a4,bridge_name='br-int',has_traffic_filtering=True,id=ac411bad-0310-4c20-946a-b95b7b3e3e16,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac411bad-03') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac411bad-03, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac411bad-03, col_values=(('external_ids', {'iface-id': 'ac411bad-0310-4c20-946a-b95b7b3e3e16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:c0:a4', 'vm-uuid': 'fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:05:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:08 user nova-compute[71516]: INFO os_vif [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:c0:a4,bridge_name='br-int',has_traffic_filtering=True,id=ac411bad-0310-4c20-946a-b95b7b3e3e16,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac411bad-03')
Apr 11 23:05:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:05:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] No VIF found with MAC fa:16:3e:e1:c0:a4, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:05:09 user nova-compute[71516]: DEBUG nova.network.neutron [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Successfully updated port: 37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "refresh_cache-5d6517f0-c4f0-4b35-a94a-610058ecc687" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquired lock "refresh_cache-5d6517f0-c4f0-4b35-a94a-610058ecc687" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:09 user nova-compute[71516]: DEBUG nova.network.neutron [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:05:09 user nova-compute[71516]: DEBUG nova.network.neutron [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Received event network-changed-37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Refreshing instance network info cache due to event network-changed-37163c3c-1128-4143-af68-134f3f922fa2. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] Acquiring lock "refresh_cache-5d6517f0-c4f0-4b35-a94a-610058ecc687" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.network.neutron [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Updated VIF entry in instance network info cache for port ac411bad-0310-4c20-946a-b95b7b3e3e16. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.network.neutron [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Updating instance_info_cache with network_info: [{"id": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "address": "fa:16:3e:e1:c0:a4", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac411bad-03", "ovs_interfaceid": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] Releasing lock "refresh_cache-fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:05:10 user nova-compute[71516]: INFO nova.compute.claims [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Claim successful on node user
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.network.neutron [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Updating instance_info_cache with network_info: [{"id": "37163c3c-1128-4143-af68-134f3f922fa2", "address": "fa:16:3e:1f:82:23", "network": {"id": "0c84d5db-4dde-46d7-8e55-dccce02872ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-146382199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "204fa09429ce4f2fafbc532805a346bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37163c3c-11", "ovs_interfaceid": "37163c3c-1128-4143-af68-134f3f922fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Releasing lock "refresh_cache-5d6517f0-c4f0-4b35-a94a-610058ecc687" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Instance network_info: |[{"id": "37163c3c-1128-4143-af68-134f3f922fa2", "address": "fa:16:3e:1f:82:23", "network": {"id": "0c84d5db-4dde-46d7-8e55-dccce02872ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-146382199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "204fa09429ce4f2fafbc532805a346bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37163c3c-11", "ovs_interfaceid": "37163c3c-1128-4143-af68-134f3f922fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] Acquired lock "refresh_cache-5d6517f0-c4f0-4b35-a94a-610058ecc687" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.network.neutron [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Refreshing network info cache for port 37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Start _get_guest_xml network_info=[{"id": "37163c3c-1128-4143-af68-134f3f922fa2", "address": "fa:16:3e:1f:82:23", "network": {"id": "0c84d5db-4dde-46d7-8e55-dccce02872ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-146382199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "204fa09429ce4f2fafbc532805a346bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37163c3c-11", "ovs_interfaceid": "37163c3c-1128-4143-af68-134f3f922fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:05:10 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:10 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2088061217',display_name='tempest-TestVolumeSwap-server-2088061217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2088061217',id=6,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcZSeQR7Wc+y8f0fYbTRcs8v3/VAfwZDXS0iV+9qSnNNj/GWc2eCD17bn79lZa3dYdLohcJtJ6JWgwR4YOz3w8nCzMZ9rJ5FuVmKT8eNb0z8wtI31+Z8kDZzhe6ZPQtuQ==',key_name='tempest-keypair-1498862326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='204fa09429ce4f2fafbc532805a346bc',ramdisk_id='',reservation_id='r-xq3mt1nf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1115138571',owner_user_name='tempest-TestVolumeSwap-1115138571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9554290c1a944393b68875dbadee5e63',uuid=5d6517f0-c4f0-4b35-a94a-610058ecc687,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37163c3c-1128-4143-af68-134f3f922fa2", "address": "fa:16:3e:1f:82:23", "network": {"id": "0c84d5db-4dde-46d7-8e55-dccce02872ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-146382199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "204fa09429ce4f2fafbc532805a346bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37163c3c-11", "ovs_interfaceid": "37163c3c-1128-4143-af68-134f3f922fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Converting VIF {"id": "37163c3c-1128-4143-af68-134f3f922fa2", "address": "fa:16:3e:1f:82:23", "network": {"id": "0c84d5db-4dde-46d7-8e55-dccce02872ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-146382199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "204fa09429ce4f2fafbc532805a346bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37163c3c-11", "ovs_interfaceid": "37163c3c-1128-4143-af68-134f3f922fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:82:23,bridge_name='br-int',has_traffic_filtering=True,id=37163c3c-1128-4143-af68-134f3f922fa2,network=Network(0c84d5db-4dde-46d7-8e55-dccce02872ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37163c3c-11') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.objects.instance [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d6517f0-c4f0-4b35-a94a-610058ecc687 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:05:10 user nova-compute[71516]:   <uuid>5d6517f0-c4f0-4b35-a94a-610058ecc687</uuid>
Apr 11 23:05:10 user nova-compute[71516]:   <name>instance-00000006</name>
Apr 11 23:05:10 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:05:10 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:05:10 user nova-compute[71516]:   <metadata>
Apr 11 23:05:10 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:05:10 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:05:10 user nova-compute[71516]:       <nova:name>tempest-TestVolumeSwap-server-2088061217</nova:name>
Apr 11 23:05:10 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:05:10</nova:creationTime>
Apr 11 23:05:10 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:05:10 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:05:10 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:05:10 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:05:10 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:05:10 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:05:10 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:05:10 user nova-compute[71516]:       <nova:owner>
Apr 11 23:05:10 user nova-compute[71516]:         <nova:user uuid="9554290c1a944393b68875dbadee5e63">tempest-TestVolumeSwap-1115138571-project-member</nova:user>
Apr 11 23:05:10 user nova-compute[71516]:         <nova:project uuid="204fa09429ce4f2fafbc532805a346bc">tempest-TestVolumeSwap-1115138571</nova:project>
Apr 11 23:05:10 user nova-compute[71516]:       </nova:owner>
Apr 11 23:05:10 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:05:10 user nova-compute[71516]:       <nova:ports>
Apr 11 23:05:10 user nova-compute[71516]:         <nova:port uuid="37163c3c-1128-4143-af68-134f3f922fa2">
Apr 11 23:05:10 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 23:05:10 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:10 user nova-compute[71516]:       </nova:ports>
Apr 11 23:05:10 user nova-compute[71516]:     </nova:instance>
Apr 11 23:05:10 user nova-compute[71516]:   </metadata>
Apr 11 23:05:10 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:05:10 user nova-compute[71516]:     <system>
Apr 11 23:05:10 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:05:10 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:05:10 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:05:10 user nova-compute[71516]:       <entry name="serial">5d6517f0-c4f0-4b35-a94a-610058ecc687</entry>
Apr 11 23:05:10 user nova-compute[71516]:       <entry name="uuid">5d6517f0-c4f0-4b35-a94a-610058ecc687</entry>
Apr 11 23:05:10 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:05:10 user nova-compute[71516]:     </system>
Apr 11 23:05:10 user nova-compute[71516]:   </sysinfo>
Apr 11 23:05:10 user nova-compute[71516]:   <os>
Apr 11 23:05:10 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:05:10 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:05:10 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:05:10 user nova-compute[71516]:   </os>
Apr 11 23:05:10 user nova-compute[71516]:   <features>
Apr 11 23:05:10 user nova-compute[71516]:     <acpi/>
Apr 11 23:05:10 user nova-compute[71516]:     <apic/>
Apr 11 23:05:10 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:05:10 user nova-compute[71516]:   </features>
Apr 11 23:05:10 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:05:10 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:05:10 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:05:10 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:05:10 user nova-compute[71516]:   </clock>
Apr 11 23:05:10 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:05:10 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:05:10 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:05:10 user nova-compute[71516]:   </cpu>
Apr 11 23:05:10 user nova-compute[71516]:   <devices>
Apr 11 23:05:10 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:05:10 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:05:10 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk"/>
Apr 11 23:05:10 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:05:10 user nova-compute[71516]:     </disk>
Apr 11 23:05:10 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:10 user nova-compute[71516]:       <mac address="fa:16:3e:1f:82:23"/>
Apr 11 23:05:10 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:10 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:10 user nova-compute[71516]:       <target dev="tap37163c3c-11"/>
Apr 11 23:05:10 user nova-compute[71516]:     </interface>
Apr 11 23:05:10 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:05:10 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/console.log" append="off"/>
Apr 11 23:05:10 user nova-compute[71516]:     </serial>
Apr 11 23:05:10 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:05:10 user nova-compute[71516]:     <video>
Apr 11 23:05:10 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:10 user nova-compute[71516]:     </video>
Apr 11 23:05:10 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:05:10 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:05:10 user nova-compute[71516]:     </rng>
Apr 11 23:05:10 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:05:10 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:05:10 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:05:10 user nova-compute[71516]:     </memballoon>
Apr 11 23:05:10 user nova-compute[71516]:   </devices>
Apr 11 23:05:10 user nova-compute[71516]: </domain>
Apr 11 23:05:10 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2088061217',display_name='tempest-TestVolumeSwap-server-2088061217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2088061217',id=6,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcZSeQR7Wc+y8f0fYbTRcs8v3/VAfwZDXS0iV+9qSnNNj/GWc2eCD17bn79lZa3dYdLohcJtJ6JWgwR4YOz3w8nCzMZ9rJ5FuVmKT8eNb0z8wtI31+Z8kDZzhe6ZPQtuQ==',key_name='tempest-keypair-1498862326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='204fa09429ce4f2fafbc532805a346bc',ramdisk_id='',reservation_id='r-xq3mt1nf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1115138571',owner_user_name='tempest-TestVolumeSwap-1115138571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9554290c1a944393b68875dbadee5e63',uuid=5d6517f0-c4f0-4b35-a94a-610058ecc687,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37163c3c-1128-4143-af68-134f3f922fa2", "address": "fa:16:3e:1f:82:23", "network": {"id": "0c84d5db-4dde-46d7-8e55-dccce02872ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-146382199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "204fa09429ce4f2fafbc532805a346bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37163c3c-11", "ovs_interfaceid": "37163c3c-1128-4143-af68-134f3f922fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Converting VIF {"id": "37163c3c-1128-4143-af68-134f3f922fa2", "address": "fa:16:3e:1f:82:23", "network": {"id": "0c84d5db-4dde-46d7-8e55-dccce02872ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-146382199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "204fa09429ce4f2fafbc532805a346bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37163c3c-11", "ovs_interfaceid": "37163c3c-1128-4143-af68-134f3f922fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:82:23,bridge_name='br-int',has_traffic_filtering=True,id=37163c3c-1128-4143-af68-134f3f922fa2,network=Network(0c84d5db-4dde-46d7-8e55-dccce02872ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37163c3c-11') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG os_vif [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:82:23,bridge_name='br-int',has_traffic_filtering=True,id=37163c3c-1128-4143-af68-134f3f922fa2,network=Network(0c84d5db-4dde-46d7-8e55-dccce02872ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37163c3c-11') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37163c3c-11, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37163c3c-11, col_values=(('external_ids', {'iface-id': '37163c3c-1128-4143-af68-134f3f922fa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:82:23', 'vm-uuid': '5d6517f0-c4f0-4b35-a94a-610058ecc687'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:10 user nova-compute[71516]: INFO os_vif [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:82:23,bridge_name='br-int',has_traffic_filtering=True,id=37163c3c-1128-4143-af68-134f3f922fa2,network=Network(0c84d5db-4dde-46d7-8e55-dccce02872ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37163c3c-11')
Apr 11 23:05:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:05:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] No VIF found with MAC fa:16:3e:1f:82:23, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG nova.network.neutron [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Updated VIF entry in instance network info cache for port 37163c3c-1128-4143-af68-134f3f922fa2. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG nova.network.neutron [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Updating instance_info_cache with network_info: [{"id": "37163c3c-1128-4143-af68-134f3f922fa2", "address": "fa:16:3e:1f:82:23", "network": {"id": "0c84d5db-4dde-46d7-8e55-dccce02872ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-146382199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "204fa09429ce4f2fafbc532805a346bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37163c3c-11", "ovs_interfaceid": "37163c3c-1128-4143-af68-134f3f922fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] Releasing lock "refresh_cache-5d6517f0-c4f0-4b35-a94a-610058ecc687" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.106s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:05:11 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 11 23:05:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG nova.policy [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe4793e0b50343c3b0795159dbcbf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a01d410ba24128b6a884f317687a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:05:11 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Creating image(s)
Apr 11 23:05:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "/opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "/opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "/opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "d9c0121a73e60af4d92170fce80ac347a47fb957" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "d9c0121a73e60af4d92170fce80ac347a47fb957" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-cb165d60-cd5b-46d0-ac37-f3d7db6e5679 req-628fdbef-15e4-4fa2-a8d8-459a18f57617 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Received event network-vif-plugged-ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cb165d60-cd5b-46d0-ac37-f3d7db6e5679 req-628fdbef-15e4-4fa2-a8d8-459a18f57617 service nova] Acquiring lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cb165d60-cd5b-46d0-ac37-f3d7db6e5679 req-628fdbef-15e4-4fa2-a8d8-459a18f57617 service nova] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cb165d60-cd5b-46d0-ac37-f3d7db6e5679 req-628fdbef-15e4-4fa2-a8d8-459a18f57617 service nova] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-cb165d60-cd5b-46d0-ac37-f3d7db6e5679 req-628fdbef-15e4-4fa2-a8d8-459a18f57617 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] No waiting events found dispatching network-vif-plugged-ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:05:11 user nova-compute[71516]: WARNING nova.compute.manager [req-cb165d60-cd5b-46d0-ac37-f3d7db6e5679 req-628fdbef-15e4-4fa2-a8d8-459a18f57617 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Received unexpected event network-vif-plugged-ac411bad-0310-4c20-946a-b95b7b3e3e16 for instance with vm_state building and task_state spawning.
Apr 11 23:05:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957.part --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957.part --force-share --output=json" returned: 0 in 0.199s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:12 user nova-compute[71516]: DEBUG nova.virt.images [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 593cabf7-840e-46c9-8f3d-2f5b1d39023f was qcow2, converting to raw {{(pid=71516) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 23:05:12 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:05:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957.part /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957.converted {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "902899b9-8c8f-404e-a110-832b3c91d526" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:05:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957.part /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957.converted" returned: 0 in 0.547s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957.converted --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-0b1efb79-22ed-402f-bbc0-568a8af6ddb8 req-07c3ed27-5df1-40ca-8784-102f6dd45226 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Received event network-vif-plugged-37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0b1efb79-22ed-402f-bbc0-568a8af6ddb8 req-07c3ed27-5df1-40ca-8784-102f6dd45226 service nova] Acquiring lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0b1efb79-22ed-402f-bbc0-568a8af6ddb8 req-07c3ed27-5df1-40ca-8784-102f6dd45226 service nova] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0b1efb79-22ed-402f-bbc0-568a8af6ddb8 req-07c3ed27-5df1-40ca-8784-102f6dd45226 service nova] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-0b1efb79-22ed-402f-bbc0-568a8af6ddb8 req-07c3ed27-5df1-40ca-8784-102f6dd45226 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] No waiting events found dispatching network-vif-plugged-37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:05:13 user nova-compute[71516]: WARNING nova.compute.manager [req-0b1efb79-22ed-402f-bbc0-568a8af6ddb8 req-07c3ed27-5df1-40ca-8784-102f6dd45226 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Received unexpected event network-vif-plugged-37163c3c-1128-4143-af68-134f3f922fa2 for instance with vm_state building and task_state spawning.
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:05:13 user nova-compute[71516]: INFO nova.compute.claims [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Claim successful on node user
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "d9c0121a73e60af4d92170fce80ac347a47fb957" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.577s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Successfully created port: a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957 --force-share --output=json" returned: 0 in 0.203s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "d9c0121a73e60af4d92170fce80ac347a47fb957" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "d9c0121a73e60af4d92170fce80ac347a47fb957" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957 --force-share --output=json" returned: 0 in 0.155s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957,backing_fmt=raw /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957,backing_fmt=raw /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk 1073741824" returned: 0 in 0.203s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "d9c0121a73e60af4d92170fce80ac347a47fb957" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.375s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-438f4a65-581c-4103-964a-bf2767d2c68a req-8f992845-5c25-4dff-be9f-e160be9728d8 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Received event network-vif-plugged-ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-438f4a65-581c-4103-964a-bf2767d2c68a req-8f992845-5c25-4dff-be9f-e160be9728d8 service nova] Acquiring lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-438f4a65-581c-4103-964a-bf2767d2c68a req-8f992845-5c25-4dff-be9f-e160be9728d8 service nova] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-438f4a65-581c-4103-964a-bf2767d2c68a req-8f992845-5c25-4dff-be9f-e160be9728d8 service nova] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-438f4a65-581c-4103-964a-bf2767d2c68a req-8f992845-5c25-4dff-be9f-e160be9728d8 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] No waiting events found dispatching network-vif-plugged-ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:05:13 user nova-compute[71516]: WARNING nova.compute.manager [req-438f4a65-581c-4103-964a-bf2767d2c68a req-8f992845-5c25-4dff-be9f-e160be9728d8 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Received unexpected event network-vif-plugged-ac411bad-0310-4c20-946a-b95b7b3e3e16 for instance with vm_state building and task_state spawning.
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957 --force-share --output=json" returned: 0 in 0.213s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Checking if we can resize image /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.042s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Cannot resize image /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG nova.objects.instance [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lazy-loading 'migration_context' on Instance uuid 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Ensure instance console log exists: /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:14 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:05:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:05:14 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Creating image(s)
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.182s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.178s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk 1073741824" returned: 0 in 0.059s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254315.0751123, fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] VM Resumed (Lifecycle Event)
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.policy [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Instance spawned successfully.
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254315.0757053, fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] VM Started (Lifecycle Event)
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.242s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Checking if we can resize image /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-8243fbcb-15cd-4665-9988-b13b79819947 req-4e9cbeca-ff18-4832-b427-0b1b82796eaf service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Received event network-vif-plugged-37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8243fbcb-15cd-4665-9988-b13b79819947 req-4e9cbeca-ff18-4832-b427-0b1b82796eaf service nova] Acquiring lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8243fbcb-15cd-4665-9988-b13b79819947 req-4e9cbeca-ff18-4832-b427-0b1b82796eaf service nova] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8243fbcb-15cd-4665-9988-b13b79819947 req-4e9cbeca-ff18-4832-b427-0b1b82796eaf service nova] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-8243fbcb-15cd-4665-9988-b13b79819947 req-4e9cbeca-ff18-4832-b427-0b1b82796eaf service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] No waiting events found dispatching network-vif-plugged-37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:05:15 user nova-compute[71516]: WARNING nova.compute.manager [req-8243fbcb-15cd-4665-9988-b13b79819947 req-4e9cbeca-ff18-4832-b427-0b1b82796eaf service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Received unexpected event network-vif-plugged-37163c3c-1128-4143-af68-134f3f922fa2 for instance with vm_state building and task_state spawning.
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Cannot resize image /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.objects.instance [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lazy-loading 'migration_context' on Instance uuid 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Ensure instance console log exists: /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.compute.manager [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Took 11.74 seconds to spawn the instance on the hypervisor.
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254315.5560143, 5d6517f0-c4f0-4b35-a94a-610058ecc687 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] VM Resumed (Lifecycle Event)
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Instance spawned successfully.
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254315.5594974, 5d6517f0-c4f0-4b35-a94a-610058ecc687 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] VM Started (Lifecycle Event)
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.compute.manager [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Took 13.49 seconds to build instance.
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.653s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.compute.manager [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Took 9.59 seconds to spawn the instance on the hypervisor.
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:15 user nova-compute[71516]: INFO nova.compute.manager [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Took 10.76 seconds to build instance.
Apr 11 23:05:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.919s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:15 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Successfully updated port: a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "refresh_cache-041d3e65-4e73-4416-8f0a-b2ff6dca3e77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquired lock "refresh_cache-041d3e65-4e73-4416-8f0a-b2ff6dca3e77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Updating instance_info_cache with network_info: [{"id": "a115300b-147f-450e-a3f8-94d5f0b70a06", "address": "fa:16:3e:dc:14:66", "network": {"id": "89fffa37-15ee-4d3d-84ff-6a77c47b321d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1750297065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a01d410ba24128b6a884f317687a7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa115300b-14", "ovs_interfaceid": "a115300b-147f-450e-a3f8-94d5f0b70a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Releasing lock "refresh_cache-041d3e65-4e73-4416-8f0a-b2ff6dca3e77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Instance network_info: |[{"id": "a115300b-147f-450e-a3f8-94d5f0b70a06", "address": "fa:16:3e:dc:14:66", "network": {"id": "89fffa37-15ee-4d3d-84ff-6a77c47b321d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1750297065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a01d410ba24128b6a884f317687a7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa115300b-14", "ovs_interfaceid": "a115300b-147f-450e-a3f8-94d5f0b70a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Start _get_guest_xml network_info=[{"id": "a115300b-147f-450e-a3f8-94d5f0b70a06", "address": "fa:16:3e:dc:14:66", "network": {"id": "89fffa37-15ee-4d3d-84ff-6a77c47b321d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1750297065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a01d410ba24128b6a884f317687a7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa115300b-14", "ovs_interfaceid": "a115300b-147f-450e-a3f8-94d5f0b70a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:05:02Z,direct_url=<?>,disk_format='qcow2',id=593cabf7-840e-46c9-8f3d-2f5b1d39023f,min_disk=0,min_ram=0,name='',owner='8d961fbef9f84333892262013d8c9a9d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/sda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'scsi', 'image_id': '593cabf7-840e-46c9-8f3d-2f5b1d39023f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:05:16 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:16 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:05:02Z,direct_url=<?>,disk_format='qcow2',id=593cabf7-840e-46c9-8f3d-2f5b1d39023f,min_disk=0,min_ram=0,name='',owner='8d961fbef9f84333892262013d8c9a9d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1001345895',display_name='tempest-AttachSCSIVolumeTestJSON-server-1001345895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1001345895',id=7,image_ref='593cabf7-840e-46c9-8f3d-2f5b1d39023f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrUyvv9xJhmprh9AK+up58UndvSccnxFuoMXv0YaoKFD6ViJ/cCVH/dZhQWHCTvniN/nJcx+Yxib3iT4OoYKuJjAnAkIXNDljHm3326qgsWCqfKYBDSjK9hSyBSEHpiew==',key_name='tempest-keypair-1505121934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13a01d410ba24128b6a884f317687a7d',ramdisk_id='',reservation_id='r-200yws17',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='593cabf7-840e-46c9-8f3d-2f5b1d39023f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2004545832',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2004545832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe4793e0b50343c3b0795159dbcbf46b',uuid=041d3e65-4e73-4416-8f0a-b2ff6dca3e77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a115300b-147f-450e-a3f8-94d5f0b70a06", "address": "fa:16:3e:dc:14:66", "network": {"id": "89fffa37-15ee-4d3d-84ff-6a77c47b321d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1750297065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a01d410ba24128b6a884f317687a7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa115300b-14", "ovs_interfaceid": "a115300b-147f-450e-a3f8-94d5f0b70a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Converting VIF {"id": "a115300b-147f-450e-a3f8-94d5f0b70a06", "address": "fa:16:3e:dc:14:66", "network": {"id": "89fffa37-15ee-4d3d-84ff-6a77c47b321d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1750297065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a01d410ba24128b6a884f317687a7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa115300b-14", "ovs_interfaceid": "a115300b-147f-450e-a3f8-94d5f0b70a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:14:66,bridge_name='br-int',has_traffic_filtering=True,id=a115300b-147f-450e-a3f8-94d5f0b70a06,network=Network(89fffa37-15ee-4d3d-84ff-6a77c47b321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa115300b-14') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.objects.instance [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lazy-loading 'pci_devices' on Instance uuid 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Successfully created port: ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:05:16 user nova-compute[71516]:   <uuid>041d3e65-4e73-4416-8f0a-b2ff6dca3e77</uuid>
Apr 11 23:05:16 user nova-compute[71516]:   <name>instance-00000007</name>
Apr 11 23:05:16 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:05:16 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:05:16 user nova-compute[71516]:   <metadata>
Apr 11 23:05:16 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:05:16 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:05:16 user nova-compute[71516]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1001345895</nova:name>
Apr 11 23:05:16 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:05:16</nova:creationTime>
Apr 11 23:05:16 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:05:16 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:05:16 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:05:16 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:05:16 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:05:16 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:05:16 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:05:16 user nova-compute[71516]:       <nova:owner>
Apr 11 23:05:16 user nova-compute[71516]:         <nova:user uuid="fe4793e0b50343c3b0795159dbcbf46b">tempest-AttachSCSIVolumeTestJSON-2004545832-project-member</nova:user>
Apr 11 23:05:16 user nova-compute[71516]:         <nova:project uuid="13a01d410ba24128b6a884f317687a7d">tempest-AttachSCSIVolumeTestJSON-2004545832</nova:project>
Apr 11 23:05:16 user nova-compute[71516]:       </nova:owner>
Apr 11 23:05:16 user nova-compute[71516]:       <nova:root type="image" uuid="593cabf7-840e-46c9-8f3d-2f5b1d39023f"/>
Apr 11 23:05:16 user nova-compute[71516]:       <nova:ports>
Apr 11 23:05:16 user nova-compute[71516]:         <nova:port uuid="a115300b-147f-450e-a3f8-94d5f0b70a06">
Apr 11 23:05:16 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 23:05:16 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:16 user nova-compute[71516]:       </nova:ports>
Apr 11 23:05:16 user nova-compute[71516]:     </nova:instance>
Apr 11 23:05:16 user nova-compute[71516]:   </metadata>
Apr 11 23:05:16 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:05:16 user nova-compute[71516]:     <system>
Apr 11 23:05:16 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:05:16 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:05:16 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:05:16 user nova-compute[71516]:       <entry name="serial">041d3e65-4e73-4416-8f0a-b2ff6dca3e77</entry>
Apr 11 23:05:16 user nova-compute[71516]:       <entry name="uuid">041d3e65-4e73-4416-8f0a-b2ff6dca3e77</entry>
Apr 11 23:05:16 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:05:16 user nova-compute[71516]:     </system>
Apr 11 23:05:16 user nova-compute[71516]:   </sysinfo>
Apr 11 23:05:16 user nova-compute[71516]:   <os>
Apr 11 23:05:16 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:05:16 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:05:16 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:05:16 user nova-compute[71516]:   </os>
Apr 11 23:05:16 user nova-compute[71516]:   <features>
Apr 11 23:05:16 user nova-compute[71516]:     <acpi/>
Apr 11 23:05:16 user nova-compute[71516]:     <apic/>
Apr 11 23:05:16 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:05:16 user nova-compute[71516]:   </features>
Apr 11 23:05:16 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:05:16 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:05:16 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:05:16 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:05:16 user nova-compute[71516]:   </clock>
Apr 11 23:05:16 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:05:16 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:05:16 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:05:16 user nova-compute[71516]:   </cpu>
Apr 11 23:05:16 user nova-compute[71516]:   <devices>
Apr 11 23:05:16 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:05:16 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:05:16 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk"/>
Apr 11 23:05:16 user nova-compute[71516]:       <target dev="sda" bus="scsi"/>
Apr 11 23:05:16 user nova-compute[71516]:       <address type="drive" controller="0" unit="0"/>
Apr 11 23:05:16 user nova-compute[71516]:     </disk>
Apr 11 23:05:16 user nova-compute[71516]:     <disk type="file" device="cdrom">
Apr 11 23:05:16 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 23:05:16 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk.config"/>
Apr 11 23:05:16 user nova-compute[71516]:       <target dev="sdb" bus="scsi"/>
Apr 11 23:05:16 user nova-compute[71516]:       <address type="drive" controller="0" unit="1"/>
Apr 11 23:05:16 user nova-compute[71516]:     </disk>
Apr 11 23:05:16 user nova-compute[71516]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 11 23:05:16 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:16 user nova-compute[71516]:       <mac address="fa:16:3e:dc:14:66"/>
Apr 11 23:05:16 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:16 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:16 user nova-compute[71516]:       <target dev="tapa115300b-14"/>
Apr 11 23:05:16 user nova-compute[71516]:     </interface>
Apr 11 23:05:16 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:05:16 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/console.log" append="off"/>
Apr 11 23:05:16 user nova-compute[71516]:     </serial>
Apr 11 23:05:16 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:05:16 user nova-compute[71516]:     <video>
Apr 11 23:05:16 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:16 user nova-compute[71516]:     </video>
Apr 11 23:05:16 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:05:16 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:05:16 user nova-compute[71516]:     </rng>
Apr 11 23:05:16 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:05:16 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:05:16 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:05:16 user nova-compute[71516]:     </memballoon>
Apr 11 23:05:16 user nova-compute[71516]:   </devices>
Apr 11 23:05:16 user nova-compute[71516]: </domain>
Apr 11 23:05:16 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1001345895',display_name='tempest-AttachSCSIVolumeTestJSON-server-1001345895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1001345895',id=7,image_ref='593cabf7-840e-46c9-8f3d-2f5b1d39023f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrUyvv9xJhmprh9AK+up58UndvSccnxFuoMXv0YaoKFD6ViJ/cCVH/dZhQWHCTvniN/nJcx+Yxib3iT4OoYKuJjAnAkIXNDljHm3326qgsWCqfKYBDSjK9hSyBSEHpiew==',key_name='tempest-keypair-1505121934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13a01d410ba24128b6a884f317687a7d',ramdisk_id='',reservation_id='r-200yws17',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='593cabf7-840e-46c9-8f3d-2f5b1d39023f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2004545832',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2004545832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe4793e0b50343c3b0795159dbcbf46b',uuid=041d3e65-4e73-4416-8f0a-b2ff6dca3e77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a115300b-147f-450e-a3f8-94d5f0b70a06", "address": "fa:16:3e:dc:14:66", "network": {"id": "89fffa37-15ee-4d3d-84ff-6a77c47b321d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1750297065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a01d410ba24128b6a884f317687a7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa115300b-14", "ovs_interfaceid": "a115300b-147f-450e-a3f8-94d5f0b70a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Converting VIF {"id": "a115300b-147f-450e-a3f8-94d5f0b70a06", "address": "fa:16:3e:dc:14:66", "network": {"id": "89fffa37-15ee-4d3d-84ff-6a77c47b321d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1750297065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a01d410ba24128b6a884f317687a7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa115300b-14", "ovs_interfaceid": "a115300b-147f-450e-a3f8-94d5f0b70a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:14:66,bridge_name='br-int',has_traffic_filtering=True,id=a115300b-147f-450e-a3f8-94d5f0b70a06,network=Network(89fffa37-15ee-4d3d-84ff-6a77c47b321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa115300b-14') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG os_vif [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:14:66,bridge_name='br-int',has_traffic_filtering=True,id=a115300b-147f-450e-a3f8-94d5f0b70a06,network=Network(89fffa37-15ee-4d3d-84ff-6a77c47b321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa115300b-14') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa115300b-14, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa115300b-14, col_values=(('external_ids', {'iface-id': 'a115300b-147f-450e-a3f8-94d5f0b70a06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:14:66', 'vm-uuid': '041d3e65-4e73-4416-8f0a-b2ff6dca3e77'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:17 user nova-compute[71516]: INFO os_vif [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:14:66,bridge_name='br-int',has_traffic_filtering=True,id=a115300b-147f-450e-a3f8-94d5f0b70a06,network=Network(89fffa37-15ee-4d3d-84ff-6a77c47b321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa115300b-14')
Apr 11 23:05:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] No BDM found with device name sda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] No VIF found with MAC fa:16:3e:dc:14:66, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:05:17 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Using config drive
Apr 11 23:05:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Received event network-changed-a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Refreshing instance network info cache due to event network-changed-a115300b-147f-450e-a3f8-94d5f0b70a06. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] Acquiring lock "refresh_cache-041d3e65-4e73-4416-8f0a-b2ff6dca3e77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] Acquired lock "refresh_cache-041d3e65-4e73-4416-8f0a-b2ff6dca3e77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG nova.network.neutron [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Refreshing network info cache for port a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:17 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Creating config drive at /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk.config
Apr 11 23:05:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm4ww09s7 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm4ww09s7" returned: 0 in 0.069s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:18 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Successfully updated port: ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquired lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:18 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:05:18 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:18 user nova-compute[71516]: DEBUG nova.network.neutron [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Updated VIF entry in instance network info cache for port a115300b-147f-450e-a3f8-94d5f0b70a06. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:05:18 user nova-compute[71516]: DEBUG nova.network.neutron [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Updating instance_info_cache with network_info: [{"id": "a115300b-147f-450e-a3f8-94d5f0b70a06", "address": "fa:16:3e:dc:14:66", "network": {"id": "89fffa37-15ee-4d3d-84ff-6a77c47b321d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1750297065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a01d410ba24128b6a884f317687a7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa115300b-14", "ovs_interfaceid": "a115300b-147f-450e-a3f8-94d5f0b70a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] Releasing lock "refresh_cache-041d3e65-4e73-4416-8f0a-b2ff6dca3e77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:18 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Updating instance_info_cache with network_info: [{"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Releasing lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:18 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Instance network_info: |[{"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:05:18 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Start _get_guest_xml network_info=[{"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:05:18 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:19 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1742434033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1742434033',id=8,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjYyFfjZ4jJzoYCxHNitzizXcyb+46lxif+p1WR3AxkPOuuDeeRO58EcoDOCV1AotgbxMzrZn7KKNU1EvmEh6aGyzyrtnw/YgTuT0xmESOl+oFG8zQeViLhG0BqUIwvWg==',key_name='tempest-keypair-1602402085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fb372296e5430e9f915be720934494',ramdisk_id='',reservation_id='r-4b344c26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2113709125',owner_user_name='tempest-TaggedAttachmentsTest-2113709125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343064f07762476ca5221be36dcbd0de',uuid=902899b9-8c8f-404e-a110-832b3c91d526,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converting VIF {"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ae:a2,bridge_name='br-int',has_traffic_filtering=True,id=ce46605b-463c-483c-9887-8923c6b74bbd,network=Network(ec308915-bf10-473b-ae96-e2933989bb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce46605b-46') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.objects.instance [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lazy-loading 'pci_devices' on Instance uuid 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:05:19 user nova-compute[71516]:   <uuid>902899b9-8c8f-404e-a110-832b3c91d526</uuid>
Apr 11 23:05:19 user nova-compute[71516]:   <name>instance-00000008</name>
Apr 11 23:05:19 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:05:19 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:05:19 user nova-compute[71516]:   <metadata>
Apr 11 23:05:19 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:05:19 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:05:19 user nova-compute[71516]:       <nova:name>tempest-device-tagging-server-1742434033</nova:name>
Apr 11 23:05:19 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:05:19</nova:creationTime>
Apr 11 23:05:19 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:05:19 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:05:19 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:05:19 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:05:19 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:05:19 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:05:19 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:05:19 user nova-compute[71516]:       <nova:owner>
Apr 11 23:05:19 user nova-compute[71516]:         <nova:user uuid="343064f07762476ca5221be36dcbd0de">tempest-TaggedAttachmentsTest-2113709125-project-member</nova:user>
Apr 11 23:05:19 user nova-compute[71516]:         <nova:project uuid="35fb372296e5430e9f915be720934494">tempest-TaggedAttachmentsTest-2113709125</nova:project>
Apr 11 23:05:19 user nova-compute[71516]:       </nova:owner>
Apr 11 23:05:19 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:05:19 user nova-compute[71516]:       <nova:ports>
Apr 11 23:05:19 user nova-compute[71516]:         <nova:port uuid="ce46605b-463c-483c-9887-8923c6b74bbd">
Apr 11 23:05:19 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 23:05:19 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:19 user nova-compute[71516]:       </nova:ports>
Apr 11 23:05:19 user nova-compute[71516]:     </nova:instance>
Apr 11 23:05:19 user nova-compute[71516]:   </metadata>
Apr 11 23:05:19 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:05:19 user nova-compute[71516]:     <system>
Apr 11 23:05:19 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:05:19 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:05:19 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:05:19 user nova-compute[71516]:       <entry name="serial">902899b9-8c8f-404e-a110-832b3c91d526</entry>
Apr 11 23:05:19 user nova-compute[71516]:       <entry name="uuid">902899b9-8c8f-404e-a110-832b3c91d526</entry>
Apr 11 23:05:19 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:05:19 user nova-compute[71516]:     </system>
Apr 11 23:05:19 user nova-compute[71516]:   </sysinfo>
Apr 11 23:05:19 user nova-compute[71516]:   <os>
Apr 11 23:05:19 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:05:19 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:05:19 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:05:19 user nova-compute[71516]:   </os>
Apr 11 23:05:19 user nova-compute[71516]:   <features>
Apr 11 23:05:19 user nova-compute[71516]:     <acpi/>
Apr 11 23:05:19 user nova-compute[71516]:     <apic/>
Apr 11 23:05:19 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:05:19 user nova-compute[71516]:   </features>
Apr 11 23:05:19 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:05:19 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:05:19 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:05:19 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:05:19 user nova-compute[71516]:   </clock>
Apr 11 23:05:19 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:05:19 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:05:19 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:05:19 user nova-compute[71516]:   </cpu>
Apr 11 23:05:19 user nova-compute[71516]:   <devices>
Apr 11 23:05:19 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:05:19 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:05:19 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk"/>
Apr 11 23:05:19 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:05:19 user nova-compute[71516]:     </disk>
Apr 11 23:05:19 user nova-compute[71516]:     <disk type="file" device="cdrom">
Apr 11 23:05:19 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 23:05:19 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk.config"/>
Apr 11 23:05:19 user nova-compute[71516]:       <target dev="hda" bus="ide"/>
Apr 11 23:05:19 user nova-compute[71516]:     </disk>
Apr 11 23:05:19 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:19 user nova-compute[71516]:       <mac address="fa:16:3e:da:ae:a2"/>
Apr 11 23:05:19 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:19 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:19 user nova-compute[71516]:       <target dev="tapce46605b-46"/>
Apr 11 23:05:19 user nova-compute[71516]:     </interface>
Apr 11 23:05:19 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:05:19 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/console.log" append="off"/>
Apr 11 23:05:19 user nova-compute[71516]:     </serial>
Apr 11 23:05:19 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:05:19 user nova-compute[71516]:     <video>
Apr 11 23:05:19 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:19 user nova-compute[71516]:     </video>
Apr 11 23:05:19 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:05:19 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:05:19 user nova-compute[71516]:     </rng>
Apr 11 23:05:19 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:05:19 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:05:19 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:05:19 user nova-compute[71516]:     </memballoon>
Apr 11 23:05:19 user nova-compute[71516]:   </devices>
Apr 11 23:05:19 user nova-compute[71516]: </domain>
Apr 11 23:05:19 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1742434033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1742434033',id=8,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjYyFfjZ4jJzoYCxHNitzizXcyb+46lxif+p1WR3AxkPOuuDeeRO58EcoDOCV1AotgbxMzrZn7KKNU1EvmEh6aGyzyrtnw/YgTuT0xmESOl+oFG8zQeViLhG0BqUIwvWg==',key_name='tempest-keypair-1602402085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fb372296e5430e9f915be720934494',ramdisk_id='',reservation_id='r-4b344c26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2113709125',owner_user_name='tempest-TaggedAttachmentsTest-2113709125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343064f07762476ca5221be36dcbd0de',uuid=902899b9-8c8f-404e-a110-832b3c91d526,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converting VIF {"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ae:a2,bridge_name='br-int',has_traffic_filtering=True,id=ce46605b-463c-483c-9887-8923c6b74bbd,network=Network(ec308915-bf10-473b-ae96-e2933989bb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce46605b-46') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG os_vif [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ae:a2,bridge_name='br-int',has_traffic_filtering=True,id=ce46605b-463c-483c-9887-8923c6b74bbd,network=Network(ec308915-bf10-473b-ae96-e2933989bb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce46605b-46') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce46605b-46, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce46605b-46, col_values=(('external_ids', {'iface-id': 'ce46605b-463c-483c-9887-8923c6b74bbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:ae:a2', 'vm-uuid': '902899b9-8c8f-404e-a110-832b3c91d526'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:19 user nova-compute[71516]: INFO os_vif [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ae:a2,bridge_name='br-int',has_traffic_filtering=True,id=ce46605b-463c-483c-9887-8923c6b74bbd,network=Network(ec308915-bf10-473b-ae96-e2933989bb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce46605b-46')
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] No BDM found with device name hda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] No VIF found with MAC fa:16:3e:da:ae:a2, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:05:19 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Using config drive
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.compute.manager [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-changed-ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.compute.manager [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Refreshing instance network info cache due to event network-changed-ce46605b-463c-483c-9887-8923c6b74bbd. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] Acquiring lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] Acquired lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG nova.network.neutron [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Refreshing network info cache for port ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:19 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Creating config drive at /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk.config
Apr 11 23:05:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpur175jsf {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpur175jsf" returned: 0 in 0.080s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] There are 0 instances to clean {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances with incomplete migration  {{(pid=71516) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG nova.network.neutron [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Updated VIF entry in instance network info cache for port ce46605b-463c-483c-9887-8923c6b74bbd. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG nova.network.neutron [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Updating instance_info_cache with network_info: [{"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] Releasing lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Received event network-vif-plugged-a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] Acquiring lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] No waiting events found dispatching network-vif-plugged-a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:05:21 user nova-compute[71516]: WARNING nova.compute.manager [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Received unexpected event network-vif-plugged-a115300b-147f-450e-a3f8-94d5f0b70a06 for instance with vm_state building and task_state spawning.
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Received event network-vif-plugged-a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] Acquiring lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] No waiting events found dispatching network-vif-plugged-a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:05:21 user nova-compute[71516]: WARNING nova.compute.manager [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Received unexpected event network-vif-plugged-a115300b-147f-450e-a3f8-94d5f0b70a06 for instance with vm_state building and task_state spawning.
Apr 11 23:05:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254321.903229, 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:05:21 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] VM Resumed (Lifecycle Event)
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:21 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Instance spawned successfully.
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:22 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:05:22 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254321.9105988, 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:05:22 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] VM Started (Lifecycle Event)
Apr 11 23:05:22 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:22 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:05:22 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:05:22 user nova-compute[71516]: INFO nova.compute.manager [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Took 10.39 seconds to spawn the instance on the hypervisor.
Apr 11 23:05:22 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:22 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:05:22 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:05:22 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:05:22 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Skipping network cache update for instance because it is Building. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 11 23:05:22 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Skipping network cache update for instance because it is Building. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 11 23:05:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:22 user nova-compute[71516]: INFO nova.compute.manager [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Took 12.07 seconds to build instance.
Apr 11 23:05:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.256s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:22 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:05:22 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:05:23 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Updating instance_info_cache with network_info: [{"id": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "address": "fa:16:3e:28:ea:b9", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32a4080-99", "ovs_interfaceid": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:23 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:05:23 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:05:23 user nova-compute[71516]: DEBUG nova.compute.manager [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-vif-plugged-ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:23 user nova-compute[71516]: DEBUG nova.compute.manager [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] No waiting events found dispatching network-vif-plugged-ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:05:23 user nova-compute[71516]: WARNING nova.compute.manager [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received unexpected event network-vif-plugged-ce46605b-463c-483c-9887-8923c6b74bbd for instance with vm_state building and task_state spawning.
Apr 11 23:05:23 user nova-compute[71516]: DEBUG nova.compute.manager [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-vif-plugged-ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:23 user nova-compute[71516]: DEBUG nova.compute.manager [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] No waiting events found dispatching network-vif-plugged-ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:05:23 user nova-compute[71516]: WARNING nova.compute.manager [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received unexpected event network-vif-plugged-ce46605b-463c-483c-9887-8923c6b74bbd for instance with vm_state building and task_state spawning.
Apr 11 23:05:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254324.211203, 902899b9-8c8f-404e-a110-832b3c91d526 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:05:24 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] VM Resumed (Lifecycle Event)
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:24 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Instance spawned successfully.
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:24 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254324.2114618, 902899b9-8c8f-404e-a110-832b3c91d526 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:05:24 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] VM Started (Lifecycle Event)
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:05:24 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:05:24 user nova-compute[71516]: INFO nova.compute.manager [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Took 9.84 seconds to spawn the instance on the hypervisor.
Apr 11 23:05:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:24 user nova-compute[71516]: INFO nova.compute.manager [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Took 11.45 seconds to build instance.
Apr 11 23:05:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "902899b9-8c8f-404e-a110-832b3c91d526" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.984s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "f79fcca6-9f11-498f-b580-5681f9589a77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "f79fcca6-9f11-498f-b580-5681f9589a77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:28 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:28 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:28 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=7867MB free_disk=26.597999572753906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:05:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:28 user nova-compute[71516]: DEBUG nova.compute.manager [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 4f95b120-0c70-45a5-969f-c1728c72d420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 8322b884-2831-48af-a67e-26c31c17f49f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 902899b9-8c8f-404e-a110-832b3c91d526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f79fcca6-9f11-498f-b580-5681f9589a77 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.911s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.500s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:05:29 user nova-compute[71516]: INFO nova.compute.claims [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Claim successful on node user
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Refreshing inventories for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Updating ProviderTree inventory for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Updating inventory in ProviderTree for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Refreshing aggregate associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, aggregates: None {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Refreshing trait associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 23:05:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:30 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:05:30 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:05:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.745s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:05:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:05:30 user nova-compute[71516]: DEBUG nova.network.neutron [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:05:30 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:05:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:05:30 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:05:30 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:05:30 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:05:30 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:05:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:05:30 user nova-compute[71516]: INFO nova.virt.block_device [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Booting with volume snapshot 982bf492-a432-431b-aa00-9cab35dd1b8a at /dev/vda
Apr 11 23:05:30 user nova-compute[71516]: DEBUG nova.policy [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:05:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:05:31 user nova-compute[71516]: DEBUG nova.network.neutron [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Successfully created port: 1c726827-fb42-4618-ac03-9051705301a0 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:31 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:05:31 user nova-compute[71516]: INFO nova.compute.claims [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Claim successful on node user
Apr 11 23:05:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.075s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:05:32 user nova-compute[71516]: INFO nova.compute.claims [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Claim successful on node user
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:05:32 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Successfully updated port: 1c726827-fb42-4618-ac03-9051705301a0 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "refresh_cache-f79fcca6-9f11-498f-b580-5681f9589a77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquired lock "refresh_cache-f79fcca6-9f11-498f-b580-5681f9589a77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.compute.manager [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Received event network-changed-1c726827-fb42-4618-ac03-9051705301a0 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.compute.manager [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Refreshing instance network info cache due to event network-changed-1c726827-fb42-4618-ac03-9051705301a0. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] Acquiring lock "refresh_cache-f79fcca6-9f11-498f-b580-5681f9589a77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:32 user nova-compute[71516]: INFO nova.virt.block_device [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Booting with volume 2f3d8fb7-2270-4c7c-b1ef-63cb207587dc at /dev/vda
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG os_brick.utils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:32 user nova-compute[71516]: INFO oslo.privsep.daemon [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp0w3thmhf/privsep.sock']
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.policy [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6c3f5f97f8d4380a97913a14fda79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ea0b8c8a4b4a1cac18e97464975fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:05:32 user sudo[81688]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp0w3thmhf/privsep.sock
Apr 11 23:05:32 user sudo[81688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:05:32 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Updating instance_info_cache with network_info: [{"id": "1c726827-fb42-4618-ac03-9051705301a0", "address": "fa:16:3e:ec:91:49", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c726827-fb", "ovs_interfaceid": "1c726827-fb42-4618-ac03-9051705301a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Releasing lock "refresh_cache-f79fcca6-9f11-498f-b580-5681f9589a77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Instance network_info: |[{"id": "1c726827-fb42-4618-ac03-9051705301a0", "address": "fa:16:3e:ec:91:49", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c726827-fb", "ovs_interfaceid": "1c726827-fb42-4618-ac03-9051705301a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] Acquired lock "refresh_cache-f79fcca6-9f11-498f-b580-5681f9589a77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:32 user nova-compute[71516]: DEBUG nova.network.neutron [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Refreshing network info cache for port 1c726827-fb42-4618-ac03-9051705301a0 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:32 user nova-compute[71516]: INFO nova.virt.block_device [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Booting with volume 0127b28a-b328-4024-8edb-b43c5c24e0b3 at /dev/vda
Apr 11 23:05:32 user nova-compute[71516]: DEBUG os_brick.utils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:33 user nova-compute[71516]: DEBUG nova.policy [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92d65920f60d4b0e811cf0bd7df65d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baaf4c6d66541b79d15d024804d934c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:05:33 user nova-compute[71516]: DEBUG nova.network.neutron [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Updated VIF entry in instance network info cache for port 1c726827-fb42-4618-ac03-9051705301a0. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:05:33 user nova-compute[71516]: DEBUG nova.network.neutron [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Updating instance_info_cache with network_info: [{"id": "1c726827-fb42-4618-ac03-9051705301a0", "address": "fa:16:3e:ec:91:49", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c726827-fb", "ovs_interfaceid": "1c726827-fb42-4618-ac03-9051705301a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] Releasing lock "refresh_cache-f79fcca6-9f11-498f-b580-5681f9589a77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:33 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Successfully created port: 53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Successfully created port: 5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:34 user sudo[81688]: pam_unix(sudo:session): session closed for user root
Apr 11 23:05:34 user nova-compute[71516]: INFO oslo.privsep.daemon [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Spawned new privsep daemon via rootwrap
Apr 11 23:05:34 user nova-compute[71516]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 23:05:34 user nova-compute[71516]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 23:05:34 user nova-compute[71516]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 11 23:05:34 user nova-compute[71516]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81691
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee7ec03-fac5-4c18-b759-bda6b1043f3e]: (2,) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:34 user nova-compute[71516]: WARNING oslo_privsep.priv_context [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] privsep daemon already running
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[674b184b-5853-4300-8fd1-224060458578]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:34 user nova-compute[71516]: WARNING os_brick.initiator.connectors.nvmeof [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ca7152-63ae-4f38-aebe-1bec4ba4891d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee50236-21e5-4ee3-955c-6814e7d18706]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e108a0-6324-4166-a821-ed89f1c096a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3ec66a-a01b-4e1b-887e-407677ab7529]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcf237b-bc6b-499b-82e3-f65902e175de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e55325-2bbe-4e08-9912-92d1efe8509f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[db948954-96b6-4f87-af46-3fcfe4ea69a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Successfully created port: 86246915-cf00-43be-b433-01b4ed88252c {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:34 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cdf442-c81c-4660-81ce-d0f1bb26bb6d]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG os_brick.utils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] <== get_connector_properties: return (1778ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating existing volume attachment record: e9fc68a1-7ba3-4250-aee4-c0551a4b4726 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:34 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:05:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad018a47-c7f9-4ebf-abf1-b68bc296ad3b]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG os_brick.utils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] <== get_connector_properties: return (2280ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:34 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating existing volume attachment record: 3a28758a-6a6a-4aa8-ab43-51e25c9be03a {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:05:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Successfully created port: 0dc3835d-017b-4411-a70a-c538768a13b7 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Successfully created port: 39a39a5d-8b30-4e73-893d-323dbde1de9f {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Successfully created port: ba2be13d-a019-4ba5-8b60-ed888cf7699e {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG os_brick.utils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd87bd30-795a-4cc1-acae-c83c0c473aff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9181f8ad-6172-433b-842d-3f60ceb8466f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e9838f-b29e-43b9-bd88-dfdf6b00f718]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[869766d1-58e6-4bca-9e2a-c72dc886b72b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:36 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:05:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52c4e05-46e5-4712-80ae-cb825738cac9]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG os_brick.utils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:36 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Updating existing volume attachment record: c73ec3d9-0faa-49fe-84a2-d493e99847b7 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:05:37 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Successfully created port: 5296123e-0b05-4e29-b252-6e2db7395f78 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:37 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Successfully created port: 7f3e80ab-f7c2-4300-a599-eed29afc0e83 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:38 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Successfully created port: d29edb78-cc5a-4e48-81af-a915190376af {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:38 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Successfully created port: dc64ce92-4113-4d3c-85fd-46ac2058a479 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:39 user nova-compute[71516]: INFO nova.virt.block_device [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Booting with volume 6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 at /dev/vdb
Apr 11 23:05:39 user nova-compute[71516]: DEBUG os_brick.utils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ee385b-9da7-4d25-a75c-5caecbbf0501]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a643fc3-fa3c-4fb9-b661-8946d9f95742]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e83d0e-d340-4409-a3e2-0673a0f29894]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e0c6d3-484e-462f-94f9-cfef6f67ef87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:39 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2d4f5b-829d-421c-bae6-5d970eb073c1]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG os_brick.utils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating existing volume attachment record: 1836de06-925e-4485-a65e-2ac4819c7164 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:05:39 user nova-compute[71516]: INFO nova.virt.block_device [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Booting with volume 6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a at /dev/vdb
Apr 11 23:05:39 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Successfully updated port: 53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG os_brick.utils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-changed-53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing instance network info cache due to event network-changed-53ff16a9-5f97-4d83-9b59-7ce5c337f392. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] Acquiring lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] Acquired lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG nova.network.neutron [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing network info cache for port 53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f5fc66-2c91-40aa-bcea-2c0687719d14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[382b03f4-bacc-4b5d-b955-a0fdeaf3b2b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aea6ee0-3c02-4224-a353-b42a612d5dab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[858b9fe8-fdfa-4990-8d6d-537b9528ac5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG nova.network.neutron [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:39 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:05:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b821288-49f6-4ab2-984a-2b8db61ce558]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG os_brick.utils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating existing volume attachment record: 08186137-e41e-48ba-acee-0bf651566dc9 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:05:39 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Successfully updated port: 5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:40 user nova-compute[71516]: DEBUG nova.network.neutron [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] Releasing lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:05:41 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Creating image(s)
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Ensure instance console log exists: /opt/stack/data/nova/instances/f79fcca6-9f11-498f-b580-5681f9589a77/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Start _get_guest_xml network_info=[{"id": "1c726827-fb42-4618-ac03-9051705301a0", "address": "fa:16:3e:ec:91:49", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c726827-fb", "ovs_interfaceid": "1c726827-fb42-4618-ac03-9051705301a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZCHvVdT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f79fcca6-9f11-498f-b580-5681f9589a77', 'attached_at': '', 'detached_at': '', 'volume_id': '21161bfc-4b3c-46f4-84c1-24df3e42a405', 'serial': '21161bfc-4b3c-46f4-84c1-24df3e42a405'}, 'disk_bus': 'virtio', 'attachment_id': 'c73ec3d9-0faa-49fe-84a2-d493e99847b7', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Successfully updated port: 9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:41 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:41 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connector [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Factory for ISCSI on None {{(pid=71516) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZCHvVdT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:41 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:41 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:41 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Successfully updated port: dd4aa184-e61f-4c14-bb1e-04e2b5c139ac {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9826174-abaa-4923-aede-c7fdf72e2336]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:05:41 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[922f826d-6cfd-4b3c-88b5-964184f0510d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405] added
Apr 11 23:05:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd24c29-a1ef-4464-8cb2-5aaeec124364]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0902356b-49a8-4efe-a992-0c237e1a7912]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NZCHvVdT {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NZCHvVdT" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5db64ed-d25f-43dd-abba-2134454bcca0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NZCHvVdT'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f78466f-2c6e-4334-84bc-116ff56804f8]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[698a3cd6-6899-4c97-89c7-0cbdae40396c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 23:05:41 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 23:05:41 user nova-compute[71516]:  {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:41 user nova-compute[71516]: WARNING os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 23:05:41 user nova-compute[71516]: 
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef60618f-553e-4ad5-9f15-abf3e59df9a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405, portal: 172.16.0.220,3260]
Apr 11 23:05:41 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405, portal: 172.16.0.220,3260] successful.
Apr 11 23:05:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c609cd-5f61-48dd-9015-8dba752af3ff]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4620c883-0b47-4421-9bc5-3411ffc2d466]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[21381990-c089-4cce-8749-170402965466]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZCHvVdT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-changed-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing instance network info cache due to event network-changed-5469ebfb-ee6b-49b3-9ae9-35423e6254a1. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Acquiring lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Acquired lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.network.neutron [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing network info cache for port 5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:41 user nova-compute[71516]: DEBUG nova.network.neutron [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.network.neutron [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Releasing lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-changed-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing instance network info cache due to event network-changed-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Acquiring lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Acquired lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.network.neutron [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing network info cache for port 9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.network.neutron [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.network.neutron [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Releasing lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-changed-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing instance network info cache due to event network-changed-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Acquiring lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Acquired lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.network.neutron [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing network info cache for port dd4aa184-e61f-4c14-bb1e-04e2b5c139ac {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.network.neutron [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Successfully updated port: 94d3ede6-25a2-498c-8b67-412a4b84272c {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Successfully updated port: 4f2220da-1007-4ae8-9c12-73a142b02b49 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26233393263383066', 'path': '/dev/sdb'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233393263383066', 'path': '/dev/sdb'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1905021876',display_name='tempest-TestVolumeBootPattern-server-1905021876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1905021876',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-kw85ohfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:31Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=f79fcca6-9f11-498f-b580-5681f9589a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c726827-fb42-4618-ac03-9051705301a0", "address": "fa:16:3e:ec:91:49", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c726827-fb", "ovs_interfaceid": "1c726827-fb42-4618-ac03-9051705301a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "1c726827-fb42-4618-ac03-9051705301a0", "address": "fa:16:3e:ec:91:49", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c726827-fb", "ovs_interfaceid": "1c726827-fb42-4618-ac03-9051705301a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:91:49,bridge_name='br-int',has_traffic_filtering=True,id=1c726827-fb42-4618-ac03-9051705301a0,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c726827-fb') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.objects.instance [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lazy-loading 'pci_devices' on Instance uuid f79fcca6-9f11-498f-b580-5681f9589a77 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:05:42 user nova-compute[71516]:   <uuid>f79fcca6-9f11-498f-b580-5681f9589a77</uuid>
Apr 11 23:05:42 user nova-compute[71516]:   <name>instance-00000009</name>
Apr 11 23:05:42 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:05:42 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:05:42 user nova-compute[71516]:   <metadata>
Apr 11 23:05:42 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:05:42 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:05:42 user nova-compute[71516]:       <nova:name>tempest-TestVolumeBootPattern-server-1905021876</nova:name>
Apr 11 23:05:42 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:05:41</nova:creationTime>
Apr 11 23:05:42 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:05:42 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:05:42 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:05:42 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:05:42 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:05:42 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:05:42 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:05:42 user nova-compute[71516]:       <nova:owner>
Apr 11 23:05:42 user nova-compute[71516]:         <nova:user uuid="589c07cd12e849cfa38423959e76c695">tempest-TestVolumeBootPattern-365588456-project-member</nova:user>
Apr 11 23:05:42 user nova-compute[71516]:         <nova:project uuid="f6700d66136e4f9590658e3103cceac8">tempest-TestVolumeBootPattern-365588456</nova:project>
Apr 11 23:05:42 user nova-compute[71516]:       </nova:owner>
Apr 11 23:05:42 user nova-compute[71516]:       <nova:ports>
Apr 11 23:05:42 user nova-compute[71516]:         <nova:port uuid="1c726827-fb42-4618-ac03-9051705301a0">
Apr 11 23:05:42 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 23:05:42 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:42 user nova-compute[71516]:       </nova:ports>
Apr 11 23:05:42 user nova-compute[71516]:     </nova:instance>
Apr 11 23:05:42 user nova-compute[71516]:   </metadata>
Apr 11 23:05:42 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:05:42 user nova-compute[71516]:     <system>
Apr 11 23:05:42 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:05:42 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:05:42 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:05:42 user nova-compute[71516]:       <entry name="serial">f79fcca6-9f11-498f-b580-5681f9589a77</entry>
Apr 11 23:05:42 user nova-compute[71516]:       <entry name="uuid">f79fcca6-9f11-498f-b580-5681f9589a77</entry>
Apr 11 23:05:42 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:05:42 user nova-compute[71516]:     </system>
Apr 11 23:05:42 user nova-compute[71516]:   </sysinfo>
Apr 11 23:05:42 user nova-compute[71516]:   <os>
Apr 11 23:05:42 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:05:42 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:05:42 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:05:42 user nova-compute[71516]:   </os>
Apr 11 23:05:42 user nova-compute[71516]:   <features>
Apr 11 23:05:42 user nova-compute[71516]:     <acpi/>
Apr 11 23:05:42 user nova-compute[71516]:     <apic/>
Apr 11 23:05:42 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:05:42 user nova-compute[71516]:   </features>
Apr 11 23:05:42 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:05:42 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:05:42 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:05:42 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:05:42 user nova-compute[71516]:   </clock>
Apr 11 23:05:42 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:05:42 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:05:42 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:05:42 user nova-compute[71516]:   </cpu>
Apr 11 23:05:42 user nova-compute[71516]:   <devices>
Apr 11 23:05:42 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:05:42 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:05:42 user nova-compute[71516]:       <source dev="/dev/sdb"/>
Apr 11 23:05:42 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:05:42 user nova-compute[71516]:       <serial>21161bfc-4b3c-46f4-84c1-24df3e42a405</serial>
Apr 11 23:05:42 user nova-compute[71516]:     </disk>
Apr 11 23:05:42 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:42 user nova-compute[71516]:       <mac address="fa:16:3e:ec:91:49"/>
Apr 11 23:05:42 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:42 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:42 user nova-compute[71516]:       <target dev="tap1c726827-fb"/>
Apr 11 23:05:42 user nova-compute[71516]:     </interface>
Apr 11 23:05:42 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:05:42 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/f79fcca6-9f11-498f-b580-5681f9589a77/console.log" append="off"/>
Apr 11 23:05:42 user nova-compute[71516]:     </serial>
Apr 11 23:05:42 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:05:42 user nova-compute[71516]:     <video>
Apr 11 23:05:42 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:42 user nova-compute[71516]:     </video>
Apr 11 23:05:42 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:05:42 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:05:42 user nova-compute[71516]:     </rng>
Apr 11 23:05:42 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:05:42 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:05:42 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:05:42 user nova-compute[71516]:     </memballoon>
Apr 11 23:05:42 user nova-compute[71516]:   </devices>
Apr 11 23:05:42 user nova-compute[71516]: </domain>
Apr 11 23:05:42 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1905021876',display_name='tempest-TestVolumeBootPattern-server-1905021876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1905021876',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-kw85ohfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:31Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=f79fcca6-9f11-498f-b580-5681f9589a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c726827-fb42-4618-ac03-9051705301a0", "address": "fa:16:3e:ec:91:49", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c726827-fb", "ovs_interfaceid": "1c726827-fb42-4618-ac03-9051705301a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "1c726827-fb42-4618-ac03-9051705301a0", "address": "fa:16:3e:ec:91:49", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c726827-fb", "ovs_interfaceid": "1c726827-fb42-4618-ac03-9051705301a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:91:49,bridge_name='br-int',has_traffic_filtering=True,id=1c726827-fb42-4618-ac03-9051705301a0,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c726827-fb') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG os_vif [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:91:49,bridge_name='br-int',has_traffic_filtering=True,id=1c726827-fb42-4618-ac03-9051705301a0,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c726827-fb') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c726827-fb, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c726827-fb, col_values=(('external_ids', {'iface-id': '1c726827-fb42-4618-ac03-9051705301a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:91:49', 'vm-uuid': 'f79fcca6-9f11-498f-b580-5681f9589a77'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:42 user nova-compute[71516]: INFO os_vif [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:91:49,bridge_name='br-int',has_traffic_filtering=True,id=1c726827-fb42-4618-ac03-9051705301a0,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c726827-fb')
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.network.neutron [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Releasing lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:05:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] No VIF found with MAC fa:16:3e:ec:91:49, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:05:43 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Successfully updated port: 0dc3835d-017b-4411-a70a-c538768a13b7 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:43 user nova-compute[71516]: DEBUG nova.compute.manager [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-changed-94d3ede6-25a2-498c-8b67-412a4b84272c {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:43 user nova-compute[71516]: DEBUG nova.compute.manager [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing instance network info cache due to event network-changed-94d3ede6-25a2-498c-8b67-412a4b84272c. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Acquiring lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Acquired lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:43 user nova-compute[71516]: DEBUG nova.network.neutron [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing network info cache for port 94d3ede6-25a2-498c-8b67-412a4b84272c {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:43 user nova-compute[71516]: DEBUG nova.network.neutron [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:44 user nova-compute[71516]: INFO nova.virt.block_device [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Booting with volume 4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 at /dev/vdc
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Successfully updated port: 86246915-cf00-43be-b433-01b4ed88252c {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.network.neutron [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG os_brick.utils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Releasing lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-changed-4f2220da-1007-4ae8-9c12-73a142b02b49 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing instance network info cache due to event network-changed-4f2220da-1007-4ae8-9c12-73a142b02b49. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Acquiring lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Acquired lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.network.neutron [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing network info cache for port 4f2220da-1007-4ae8-9c12-73a142b02b49 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[11124f37-debc-4c4d-9dd1-75c3abeec2a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f4b660-2ce3-4782-bec2-c18a7ce3af15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[070f332e-3fe2-4c56-a629-77f91f783966]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1383eb9b-d7d7-473a-aaac-39e019ae0ef8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.network.neutron [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:44 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc2e88e-0787-45c7-9c52-db7b4c4199fd]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG os_brick.utils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating existing volume attachment record: ab43324f-207b-4ef9-b547-a9f7481186d9 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-b2518d2f-2582-4963-b2ca-21b81d480fb0 req-c6d76997-3a60-4fe1-8f22-ce781c7bd64f service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Received event network-vif-plugged-1c726827-fb42-4618-ac03-9051705301a0 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b2518d2f-2582-4963-b2ca-21b81d480fb0 req-c6d76997-3a60-4fe1-8f22-ce781c7bd64f service nova] Acquiring lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b2518d2f-2582-4963-b2ca-21b81d480fb0 req-c6d76997-3a60-4fe1-8f22-ce781c7bd64f service nova] Lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b2518d2f-2582-4963-b2ca-21b81d480fb0 req-c6d76997-3a60-4fe1-8f22-ce781c7bd64f service nova] Lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-b2518d2f-2582-4963-b2ca-21b81d480fb0 req-c6d76997-3a60-4fe1-8f22-ce781c7bd64f service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] No waiting events found dispatching network-vif-plugged-1c726827-fb42-4618-ac03-9051705301a0 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:05:44 user nova-compute[71516]: WARNING nova.compute.manager [req-b2518d2f-2582-4963-b2ca-21b81d480fb0 req-c6d76997-3a60-4fe1-8f22-ce781c7bd64f service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Received unexpected event network-vif-plugged-1c726827-fb42-4618-ac03-9051705301a0 for instance with vm_state building and task_state spawning.
Apr 11 23:05:44 user nova-compute[71516]: INFO nova.virt.block_device [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Booting with volume 39261de4-8b4d-4e01-b027-628663c9a7fd at /dev/vdc
Apr 11 23:05:44 user nova-compute[71516]: DEBUG os_brick.utils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[50620a59-e843-4295-b665-6eeb67db3011]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c47731-0cff-4bff-8c87-9e9c95fcecbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4009a8ae-2d83-433c-8be5-df0549121d54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d0423e-fdb8-4035-bed6-aa588cfbb0e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:05:44 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[70607cac-fecb-4ed8-af30-7c6a8262b3d0]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG os_brick.utils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating existing volume attachment record: 35208ed4-0d7e-46b1-a51a-50f45a9c80fb {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.network.neutron [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Releasing lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-changed-0dc3835d-017b-4411-a70a-c538768a13b7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing instance network info cache due to event network-changed-0dc3835d-017b-4411-a70a-c538768a13b7. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Acquiring lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Acquired lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.network.neutron [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing network info cache for port 0dc3835d-017b-4411-a70a-c538768a13b7 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:44 user nova-compute[71516]: DEBUG nova.network.neutron [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:45 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Successfully updated port: ba2be13d-a019-4ba5-8b60-ed888cf7699e {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:45 user nova-compute[71516]: DEBUG nova.network.neutron [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Releasing lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:45 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Successfully updated port: 39a39a5d-8b30-4e73-893d-323dbde1de9f {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:45 user nova-compute[71516]: DEBUG nova.compute.manager [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-changed-86246915-cf00-43be-b433-01b4ed88252c {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:45 user nova-compute[71516]: DEBUG nova.compute.manager [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing instance network info cache due to event network-changed-86246915-cf00-43be-b433-01b4ed88252c. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Acquiring lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Acquired lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:45 user nova-compute[71516]: DEBUG nova.network.neutron [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing network info cache for port 86246915-cf00-43be-b433-01b4ed88252c {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Successfully updated port: 7f3e80ab-f7c2-4300-a599-eed29afc0e83 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.network.neutron [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254346.2296956, f79fcca6-9f11-498f-b580-5681f9589a77 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:05:46 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] VM Resumed (Lifecycle Event)
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:05:46 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Instance spawned successfully.
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:05:46 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254346.230468, f79fcca6-9f11-498f-b580-5681f9589a77 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:05:46 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] VM Started (Lifecycle Event)
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.network.neutron [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Releasing lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-changed-ba2be13d-a019-4ba5-8b60-ed888cf7699e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing instance network info cache due to event network-changed-ba2be13d-a019-4ba5-8b60-ed888cf7699e. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Acquiring lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Acquired lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.network.neutron [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing network info cache for port ba2be13d-a019-4ba5-8b60-ed888cf7699e {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:46 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:05:46 user nova-compute[71516]: INFO nova.compute.manager [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Took 5.17 seconds to spawn the instance on the hypervisor.
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.network.neutron [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:46 user nova-compute[71516]: INFO nova.compute.manager [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Took 17.66 seconds to build instance.
Apr 11 23:05:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "f79fcca6-9f11-498f-b580-5681f9589a77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.790s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-908e0639-cef8-4009-bcd4-132bb713ea96 req-36e25f15-dd6f-40cb-a248-d157ed90de1d service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Received event network-vif-plugged-1c726827-fb42-4618-ac03-9051705301a0 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-908e0639-cef8-4009-bcd4-132bb713ea96 req-36e25f15-dd6f-40cb-a248-d157ed90de1d service nova] Acquiring lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-908e0639-cef8-4009-bcd4-132bb713ea96 req-36e25f15-dd6f-40cb-a248-d157ed90de1d service nova] Lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-908e0639-cef8-4009-bcd4-132bb713ea96 req-36e25f15-dd6f-40cb-a248-d157ed90de1d service nova] Lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-908e0639-cef8-4009-bcd4-132bb713ea96 req-36e25f15-dd6f-40cb-a248-d157ed90de1d service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] No waiting events found dispatching network-vif-plugged-1c726827-fb42-4618-ac03-9051705301a0 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:05:46 user nova-compute[71516]: WARNING nova.compute.manager [req-908e0639-cef8-4009-bcd4-132bb713ea96 req-36e25f15-dd6f-40cb-a248-d157ed90de1d service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Received unexpected event network-vif-plugged-1c726827-fb42-4618-ac03-9051705301a0 for instance with vm_state active and task_state None.
Apr 11 23:05:46 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Successfully updated port: 5296123e-0b05-4e29-b252-6e2db7395f78 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG nova.network.neutron [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Releasing lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG nova.compute.manager [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-changed-39a39a5d-8b30-4e73-893d-323dbde1de9f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG nova.compute.manager [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing instance network info cache due to event network-changed-39a39a5d-8b30-4e73-893d-323dbde1de9f. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Acquiring lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Acquired lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG nova.network.neutron [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing network info cache for port 39a39a5d-8b30-4e73-893d-323dbde1de9f {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG nova.network.neutron [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Successfully updated port: dc64ce92-4113-4d3c-85fd-46ac2058a479 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquired lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG nova.network.neutron [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Releasing lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:48 user nova-compute[71516]: DEBUG nova.compute.manager [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-changed-7f3e80ab-f7c2-4300-a599-eed29afc0e83 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:48 user nova-compute[71516]: DEBUG nova.compute.manager [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing instance network info cache due to event network-changed-7f3e80ab-f7c2-4300-a599-eed29afc0e83. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Acquiring lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:48 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Successfully updated port: d29edb78-cc5a-4e48-81af-a915190376af {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:05:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquired lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:48 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:05:48 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:05:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:05:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:05:49 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Creating image(s)
Apr 11 23:05:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:05:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Ensure instance console log exists: /opt/stack/data/nova/instances/f59cffaa-b1e0-427d-b395-1043bad9a5c7/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:05:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:05:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:05:49 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Creating image(s)
Apr 11 23:05:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:05:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Ensure instance console log exists: /opt/stack/data/nova/instances/89644573-5fbc-4ab4-a16b-23b7c4f6c598/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:05:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:05:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:05:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:05:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-changed-d29edb78-cc5a-4e48-81af-a915190376af {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing instance network info cache due to event network-changed-d29edb78-cc5a-4e48-81af-a915190376af. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] Acquiring lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating instance_info_cache with network_info: [{"id": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "address": "fa:16:3e:50:71:df", "network": {"id": "d9a27961-c537-4aa6-9fba-dbd50ba4d719", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1712790655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5469ebfb-ee", "ovs_interfaceid": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dc3835d-017b-4411-a70a-c538768a13b7", "address": "fa:16:3e:5a:b7:bd", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc3835d-01", "ovs_interfaceid": "0dc3835d-017b-4411-a70a-c538768a13b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Releasing lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Instance network_info: |[{"id": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "address": "fa:16:3e:50:71:df", "network": {"id": "d9a27961-c537-4aa6-9fba-dbd50ba4d719", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1712790655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5469ebfb-ee", "ovs_interfaceid": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dc3835d-017b-4411-a70a-c538768a13b7", "address": "fa:16:3e:5a:b7:bd", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc3835d-01", "ovs_interfaceid": "0dc3835d-017b-4411-a70a-c538768a13b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Acquired lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.network.neutron [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing network info cache for port 7f3e80ab-f7c2-4300-a599-eed29afc0e83 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Start _get_guest_xml network_info=[{"id": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "address": "fa:16:3e:50:71:df", "network": {"id": "d9a27961-c537-4aa6-9fba-dbd50ba4d719", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1712790655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5469ebfb-ee", "ovs_interfaceid": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dc3835d-017b-4411-a70a-c538768a13b7", "address": "fa:16:3e:5a:b7:bd", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc3835d-01", "ovs_interfaceid": "0dc3835d-017b-4411-a70a-c538768a13b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQRaYIFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f59cffaa-b1e0-427d-b395-1043bad9a5c7', 'attached_at': '', 'detached_at': '', 'volume_id': '0127b28a-b328-4024-8edb-b43c5c24e0b3', 'serial': '0127b28a-b328-4024-8edb-b43c5c24e0b3'}, 'disk_bus': 'virtio', 'attachment_id': 'e9fc68a1-7ba3-4250-aee4-c0551a4b4726', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrzWdpGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f59cffaa-b1e0-427d-b395-1043bad9a5c7', 'attached_at': '', 'detached_at': '', 'volume_id': '6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9', 'serial': '6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9'}, 'disk_bus': 'virtio', 'attachment_id': '1836de06-925e-4485-a65e-2ac4819c7164', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdZOLzAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f59cffaa-b1e0-427d-b395-1043bad9a5c7', 'attached_at': '', 'detached_at': '', 'volume_id': '4c7aa8aa-2f09-46de-80ee-15a1f75cbe57', 'serial': '4c7aa8aa-2f09-46de-80ee-15a1f75cbe57'}, 'disk_bus': 'virtio', 'attachment_id': 'ab43324f-207b-4ef9-b547-a9f7481186d9', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:05:51 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:51 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQRaYIFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:51 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:51 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:51 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2540b4e0-26eb-46b5-89c2-96de3c565189]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:05:51 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4777369b-331e-45b5-a28f-3c86e1d86aaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3] added
Apr 11 23:05:51 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad6ce52-9c83-438e-85d0-d46d388f35d1]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e519429-3bd8-4eb7-b60d-18ce2437b331]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EQRaYIFP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EQRaYIFP" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[09411ad7-6f47-4ab6-b79b-00e737f3b201]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EQRaYIFP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[829b4beb-1b6e-48a5-ac15-789273c808ff]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba0acae-9394-4b1d-a039-0b877f57d290]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:51 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:51 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf346df8-3bdc-405d-8ad7-14a33ca4e184]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3, portal: 172.16.0.220,3260]
Apr 11 23:05:51 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3, portal: 172.16.0.220,3260] successful.
Apr 11 23:05:51 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3499b7e-6ea6-43da-b404-315d2d93f031]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a98d9ea-79d0-48a4-b2e7-a3a7b5497491]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:52 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:52 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:52 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:52 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[668bc33c-706c-417f-8a4d-ecd780aba175]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQRaYIFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.network.neutron [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updated VIF entry in instance network info cache for port 7f3e80ab-f7c2-4300-a599-eed29afc0e83. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.network.neutron [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating instance_info_cache with network_info: [{"id": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "address": "fa:16:3e:50:71:df", "network": {"id": "d9a27961-c537-4aa6-9fba-dbd50ba4d719", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1712790655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5469ebfb-ee", "ovs_interfaceid": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dc3835d-017b-4411-a70a-c538768a13b7", "address": "fa:16:3e:5a:b7:bd", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc3835d-01", "ovs_interfaceid": "0dc3835d-017b-4411-a70a-c538768a13b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [{"id": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "address": "fa:16:3e:d7:2d:8b", "network": {"id": "a341e6d3-4f4c-44c5-a510-cd0b61eb81cd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-604450370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ff16a9-5f", "ovs_interfaceid": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5296123e-0b05-4e29-b252-6e2db7395f78", "address": "fa:16:3e:90:c9:63", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296123e-0b", "ovs_interfaceid": "5296123e-0b05-4e29-b252-6e2db7395f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Releasing lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-changed-5296123e-0b05-4e29-b252-6e2db7395f78 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing instance network info cache due to event network-changed-5296123e-0b05-4e29-b252-6e2db7395f78. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Acquiring lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Releasing lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.compute.manager [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Instance network_info: |[{"id": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "address": "fa:16:3e:d7:2d:8b", "network": {"id": "a341e6d3-4f4c-44c5-a510-cd0b61eb81cd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-604450370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ff16a9-5f", "ovs_interfaceid": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5296123e-0b05-4e29-b252-6e2db7395f78", "address": "fa:16:3e:90:c9:63", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296123e-0b", "ovs_interfaceid": "5296123e-0b05-4e29-b252-6e2db7395f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] Acquired lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.network.neutron [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing network info cache for port d29edb78-cc5a-4e48-81af-a915190376af {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Start _get_guest_xml network_info=[{"id": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "address": "fa:16:3e:d7:2d:8b", "network": {"id": "a341e6d3-4f4c-44c5-a510-cd0b61eb81cd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-604450370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ff16a9-5f", "ovs_interfaceid": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5296123e-0b05-4e29-b252-6e2db7395f78", "address": "fa:16:3e:90:c9:63", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296123e-0b", "ovs_interfaceid": "5296123e-0b05-4e29-b252-6e2db7395f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIJzmDtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89644573-5fbc-4ab4-a16b-23b7c4f6c598', 'attached_at': '', 'detached_at': '', 'volume_id': '2f3d8fb7-2270-4c7c-b1ef-63cb207587dc', 'serial': '2f3d8fb7-2270-4c7c-b1ef-63cb207587dc'}, 'disk_bus': 'virtio', 'attachment_id': '3a28758a-6a6a-4aa8-ab43-51e25c9be03a', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kClvGofd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89644573-5fbc-4ab4-a16b-23b7c4f6c598', 'attached_at': '', 'detached_at': '', 'volume_id': '6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a', 'serial': '6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a'}, 'disk_bus': 'virtio', 'attachment_id': '08186137-e41e-48ba-acee-0bf651566dc9', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jisYQKLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89644573-5fbc-4ab4-a16b-23b7c4f6c598', 'attached_at': '', 'detached_at': '', 'volume_id': '39261de4-8b4d-4e01-b027-628663c9a7fd', 'serial': '39261de4-8b4d-4e01-b027-628663c9a7fd'}, 'disk_bus': 'virtio', 'attachment_id': '35208ed4-0d7e-46b1-a51a-50f45a9c80fb', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:05:52 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:52 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:05:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIJzmDtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:52 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23431636261326639', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431636261326639', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.331s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:53 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:53 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d72d300-e052-4480-a447-0718de3b08b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:05:53 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updated VIF entry in instance network info cache for port d29edb78-cc5a-4e48-81af-a915190376af. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [{"id": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "address": "fa:16:3e:d7:2d:8b", "network": {"id": "a341e6d3-4f4c-44c5-a510-cd0b61eb81cd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-604450370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ff16a9-5f", "ovs_interfaceid": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5296123e-0b05-4e29-b252-6e2db7395f78", "address": "fa:16:3e:90:c9:63", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296123e-0b", "ovs_interfaceid": "5296123e-0b05-4e29-b252-6e2db7395f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c909cb-d81c-4786-9cc5-7c7649f31d4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc] added
Apr 11 23:05:53 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] Releasing lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Acquired lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing network info cache for port 5296123e-0b05-4e29-b252-6e2db7395f78 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca38c600-3e96-46df-b282-5df0fdc5054d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrzWdpGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:53 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa6a46d-2d02-4606-a6cd-799bc18f3d69]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eIJzmDtU {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eIJzmDtU" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3934e5-4efe-4d1e-927a-4ce3dc070b16]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eIJzmDtU'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6879b9b-5359-4789-92dc-ca95db9f967c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df8a2ca-017f-4e81-a779-5806cb452d6b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:53 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:53 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:53 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:53 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7b44d9-f49d-4eb1-8ca0-8bb399ed814a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc, portal: 172.16.0.220,3260]
Apr 11 23:05:53 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc, portal: 172.16.0.220,3260] successful.
Apr 11 23:05:53 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ef7045-482a-48ce-a81e-9aba01fe6711]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[589eca21-1e09-4e56-a900-674780acd296]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:53 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:53 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:53 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:53 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:53 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:53 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadc781c-7eb4-49a7-a9b3-8de8dbbcd2f3]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIJzmDtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updated VIF entry in instance network info cache for port 5296123e-0b05-4e29-b252-6e2db7395f78. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [{"id": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "address": "fa:16:3e:d7:2d:8b", "network": {"id": "a341e6d3-4f4c-44c5-a510-cd0b61eb81cd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-604450370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ff16a9-5f", "ovs_interfaceid": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5296123e-0b05-4e29-b252-6e2db7395f78", "address": "fa:16:3e:90:c9:63", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296123e-0b", "ovs_interfaceid": "5296123e-0b05-4e29-b252-6e2db7395f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Releasing lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-changed-dc64ce92-4113-4d3c-85fd-46ac2058a479 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing instance network info cache due to event network-changed-dc64ce92-4113-4d3c-85fd-46ac2058a479. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Acquiring lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Acquired lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:05:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing network info cache for port dc64ce92-4113-4d3c-85fd-46ac2058a479 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG nova.network.neutron [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updated VIF entry in instance network info cache for port dc64ce92-4113-4d3c-85fd-46ac2058a479. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG nova.network.neutron [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating instance_info_cache with network_info: [{"id": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "address": "fa:16:3e:50:71:df", "network": {"id": "d9a27961-c537-4aa6-9fba-dbd50ba4d719", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1712790655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5469ebfb-ee", "ovs_interfaceid": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dc3835d-017b-4411-a70a-c538768a13b7", "address": "fa:16:3e:5a:b7:bd", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc3835d-01", "ovs_interfaceid": "0dc3835d-017b-4411-a70a-c538768a13b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Releasing lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] <== connect_volume: return (1680ms) {'type': 'block', 'scsi_wwn': '26431646637336234', 'path': '/dev/sdd'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431646637336234', 'path': '/dev/sdd'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.260s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:54 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:54 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c304385-cca5-4a3f-a82d-52519af0682d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:05:54 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kClvGofd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:54 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae19bcf-6aee-4efd-88c7-2654db87c15f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9] added
Apr 11 23:05:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d01d7d-a032-42b2-87a5-84c0cfddd300]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[982aff85-8025-4528-9a8d-0e76b0a81b98]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PrzWdpGL {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PrzWdpGL" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6e3e21-047b-4da7-a81d-beef3fa61b72]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PrzWdpGL'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[842ce81c-8842-4f07-bcb8-a85d88847371]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b300c65-36d7-445b-a341-481d5ffab606]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:54 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:54 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:54 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:54 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9a241a-5921-43e9-b0fc-f41e5b73cbf5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9, portal: 172.16.0.220,3260]
Apr 11 23:05:54 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9, portal: 172.16.0.220,3260] successful.
Apr 11 23:05:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc4cf37-faa3-47db-8a62-d77d052bfdb1]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5b8115-5aeb-4219-9a8a-d5348f0f8b36]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:54 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:54 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:54 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:54 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:54 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:54 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac9b60f-1328-4301-b5db-61629fdabe26]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:05:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrzWdpGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] <== connect_volume: return (2581ms) {'type': 'block', 'scsi_wwn': '26134613066306665', 'path': '/dev/sde'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134613066306665', 'path': '/dev/sde'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.295s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:55 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:55 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ab4eb4-560b-48fe-973e-5e38957c0669]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:05:55 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdZOLzAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:55 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac6ff8f-2878-4998-a285-0b185c6f7b48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a] added
Apr 11 23:05:55 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af74785-50c7-4472-89e0-d313d7195a83]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0587706-29ad-4c26-8f50-08d540149ae1]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kClvGofd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kClvGofd" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[61454eeb-dd69-45a1-a3d3-56b017b08011]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kClvGofd'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d994470b-6ce7-4294-b94f-9adb7a50ea1f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[66790fec-38ae-4a99-a786-2237ad09d469]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:55 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:55 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:55 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:55 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:55 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:55 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:55 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:55 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[000d3159-dee2-4a38-b608-8503b09af0eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a, portal: 172.16.0.220,3260]
Apr 11 23:05:55 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a, portal: 172.16.0.220,3260] successful.
Apr 11 23:05:55 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8030af3b-ea84-42bc-a395-9cd8d9c659e9]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b9076a-c287-470e-a1e0-76a16074aa87]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:56 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:56 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:56 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:56 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:05:56 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:56 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:56 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:56 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:56 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:05:56 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[04954ad8-61ab-407e-8b2c-539ce2e96a14]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:05:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kClvGofd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] <== connect_volume: return (2611ms) {'type': 'block', 'scsi_wwn': '26365323733623039', 'path': '/dev/sdf'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365323733623039', 'path': '/dev/sdf'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.289s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:57 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:57 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45e0f61-936b-426e-bdc3-a033cfaee936]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:05:57 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jisYQKLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:05:57 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb26fb18-1214-4e7d-8f5a-2dc58578dcf8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57] added
Apr 11 23:05:57 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e15098e-1be7-4cdc-8122-5c906294f52a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e614d2-de7f-4f89-82a1-41814e352c9b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WdZOLzAV {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WdZOLzAV" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9780c2-1e9b-4d8c-992e-5fb8cf39553a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WdZOLzAV'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44b648e-1d72-414c-be3e-f66a0319164c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17b809f-ee6e-4746-8496-a23aff2e4883]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:05:57 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:05:57 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9f258e-daeb-466b-87a6-11a2809f5a57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57, portal: 172.16.0.220,3260]
Apr 11 23:05:57 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57, portal: 172.16.0.220,3260] successful.
Apr 11 23:05:57 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6948e4-e5ed-4b51-8861-91e7930d6b2a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bc3e80-858f-4df1-868d-706b54bc5a4e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:05:57 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:05:57 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13e97ab-5c1c-4486-b1e0-36473741758b]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdZOLzAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:05:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] <== connect_volume: return (2633ms) {'type': 'block', 'scsi_wwn': '26237636561333163', 'path': '/dev/sdg'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237636561333163', 'path': '/dev/sdg'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.315s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:58 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:05:58 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[db35a7c8-5821-421e-a32c-93d0ca636571]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:05:58 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "address": "fa:16:3e:50:71:df", "network": {"id": "d9a27961-c537-4aa6-9fba-dbd50ba4d719", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1712790655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5469ebfb-ee", "ovs_interfaceid": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "address": "fa:16:3e:50:71:df", "network": {"id": "d9a27961-c537-4aa6-9fba-dbd50ba4d719", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1712790655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5469ebfb-ee", "ovs_interfaceid": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:71:df,bridge_name='br-int',has_traffic_filtering=True,id=5469ebfb-ee6b-49b3-9ae9-35423e6254a1,network=Network(d9a27961-c537-4aa6-9fba-dbd50ba4d719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5469ebfb-ee') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=dd4aa184-e61f-4c14-bb1e-04e2b5c139ac,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd4aa184-e6') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:90:c1,bridge_name='br-int',has_traffic_filtering=True,id=94d3ede6-25a2-498c-8b67-412a4b84272c,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94d3ede6-25') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dc3835d-017b-4411-a70a-c538768a13b7", "address": "fa:16:3e:5a:b7:bd", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc3835d-01", "ovs_interfaceid": "0dc3835d-017b-4411-a70a-c538768a13b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "0dc3835d-017b-4411-a70a-c538768a13b7", "address": "fa:16:3e:5a:b7:bd", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc3835d-01", "ovs_interfaceid": "0dc3835d-017b-4411-a70a-c538768a13b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:b7:bd,bridge_name='br-int',has_traffic_filtering=True,id=0dc3835d-017b-4411-a70a-c538768a13b7,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc3835d-01') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:66:59,bridge_name='br-int',has_traffic_filtering=True,id=ba2be13d-a019-4ba5-8b60-ed888cf7699e,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2be13d-a0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:60:34,bridge_name='br-int',has_traffic_filtering=True,id=7f3e80ab-f7c2-4300-a599-eed29afc0e83,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3e80ab-f7') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:4c:27,bridge_name='br-int',has_traffic_filtering=True,id=dc64ce92-4113-4d3c-85fd-46ac2058a479,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64ce92-41') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.objects.instance [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lazy-loading 'pci_devices' on Instance uuid f59cffaa-b1e0-427d-b395-1043bad9a5c7 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a1ac18-1e39-44b6-ae07-d841feb63157]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd] added
Apr 11 23:05:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:05:58 user nova-compute[71516]:   <uuid>f59cffaa-b1e0-427d-b395-1043bad9a5c7</uuid>
Apr 11 23:05:58 user nova-compute[71516]:   <name>instance-0000000b</name>
Apr 11 23:05:58 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:05:58 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:05:58 user nova-compute[71516]:   <metadata>
Apr 11 23:05:58 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:05:58 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:05:58 user nova-compute[71516]:       <nova:name>tempest-device-tagging-server-1259538714</nova:name>
Apr 11 23:05:58 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:05:51</nova:creationTime>
Apr 11 23:05:58 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:05:58 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:05:58 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:05:58 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:05:58 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:05:58 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:05:58 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:05:58 user nova-compute[71516]:       <nova:owner>
Apr 11 23:05:58 user nova-compute[71516]:         <nova:user uuid="92d65920f60d4b0e811cf0bd7df65d35">tempest-TaggedBootDevicesTest-1216653283-project-member</nova:user>
Apr 11 23:05:58 user nova-compute[71516]:         <nova:project uuid="4baaf4c6d66541b79d15d024804d934c">tempest-TaggedBootDevicesTest-1216653283</nova:project>
Apr 11 23:05:58 user nova-compute[71516]:       </nova:owner>
Apr 11 23:05:58 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:05:58 user nova-compute[71516]:       <nova:ports>
Apr 11 23:05:58 user nova-compute[71516]:         <nova:port uuid="5469ebfb-ee6b-49b3-9ae9-35423e6254a1">
Apr 11 23:05:58 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 23:05:58 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:58 user nova-compute[71516]:         <nova:port uuid="dd4aa184-e61f-4c14-bb1e-04e2b5c139ac">
Apr 11 23:05:58 user nova-compute[71516]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Apr 11 23:05:58 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:58 user nova-compute[71516]:         <nova:port uuid="94d3ede6-25a2-498c-8b67-412a4b84272c">
Apr 11 23:05:58 user nova-compute[71516]:           <nova:ip type="fixed" address="10.1.1.94" ipVersion="4"/>
Apr 11 23:05:58 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:58 user nova-compute[71516]:         <nova:port uuid="0dc3835d-017b-4411-a70a-c538768a13b7">
Apr 11 23:05:58 user nova-compute[71516]:           <nova:ip type="fixed" address="10.1.1.180" ipVersion="4"/>
Apr 11 23:05:58 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:58 user nova-compute[71516]:         <nova:port uuid="ba2be13d-a019-4ba5-8b60-ed888cf7699e">
Apr 11 23:05:58 user nova-compute[71516]:           <nova:ip type="fixed" address="10.1.1.129" ipVersion="4"/>
Apr 11 23:05:58 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:58 user nova-compute[71516]:         <nova:port uuid="7f3e80ab-f7c2-4300-a599-eed29afc0e83">
Apr 11 23:05:58 user nova-compute[71516]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 23:05:58 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:58 user nova-compute[71516]:         <nova:port uuid="dc64ce92-4113-4d3c-85fd-46ac2058a479">
Apr 11 23:05:58 user nova-compute[71516]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 23:05:58 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:58 user nova-compute[71516]:       </nova:ports>
Apr 11 23:05:58 user nova-compute[71516]:     </nova:instance>
Apr 11 23:05:58 user nova-compute[71516]:   </metadata>
Apr 11 23:05:58 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:05:58 user nova-compute[71516]:     <system>
Apr 11 23:05:58 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:05:58 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:05:58 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:05:58 user nova-compute[71516]:       <entry name="serial">f59cffaa-b1e0-427d-b395-1043bad9a5c7</entry>
Apr 11 23:05:58 user nova-compute[71516]:       <entry name="uuid">f59cffaa-b1e0-427d-b395-1043bad9a5c7</entry>
Apr 11 23:05:58 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:05:58 user nova-compute[71516]:     </system>
Apr 11 23:05:58 user nova-compute[71516]:   </sysinfo>
Apr 11 23:05:58 user nova-compute[71516]:   <os>
Apr 11 23:05:58 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:05:58 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:05:58 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:05:58 user nova-compute[71516]:   </os>
Apr 11 23:05:58 user nova-compute[71516]:   <features>
Apr 11 23:05:58 user nova-compute[71516]:     <acpi/>
Apr 11 23:05:58 user nova-compute[71516]:     <apic/>
Apr 11 23:05:58 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:05:58 user nova-compute[71516]:   </features>
Apr 11 23:05:58 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:05:58 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:05:58 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:05:58 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:05:58 user nova-compute[71516]:   </clock>
Apr 11 23:05:58 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:05:58 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:05:58 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:05:58 user nova-compute[71516]:   </cpu>
Apr 11 23:05:58 user nova-compute[71516]:   <devices>
Apr 11 23:05:58 user nova-compute[71516]:     <disk type="file" device="cdrom">
Apr 11 23:05:58 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 23:05:58 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/f59cffaa-b1e0-427d-b395-1043bad9a5c7/disk.config"/>
Apr 11 23:05:58 user nova-compute[71516]:       <target dev="hda" bus="ide"/>
Apr 11 23:05:58 user nova-compute[71516]:     </disk>
Apr 11 23:05:58 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:05:58 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:05:58 user nova-compute[71516]:       <source dev="/dev/sdc"/>
Apr 11 23:05:58 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:05:58 user nova-compute[71516]:       <serial>0127b28a-b328-4024-8edb-b43c5c24e0b3</serial>
Apr 11 23:05:58 user nova-compute[71516]:     </disk>
Apr 11 23:05:58 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:05:58 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:05:58 user nova-compute[71516]:       <source dev="/dev/sde"/>
Apr 11 23:05:58 user nova-compute[71516]:       <target dev="vdb" bus="virtio"/>
Apr 11 23:05:58 user nova-compute[71516]:       <serial>6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9</serial>
Apr 11 23:05:58 user nova-compute[71516]:     </disk>
Apr 11 23:05:58 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:05:58 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:05:58 user nova-compute[71516]:       <source dev="/dev/sdg"/>
Apr 11 23:05:58 user nova-compute[71516]:       <target dev="vdc" bus="virtio"/>
Apr 11 23:05:58 user nova-compute[71516]:       <serial>4c7aa8aa-2f09-46de-80ee-15a1f75cbe57</serial>
Apr 11 23:05:58 user nova-compute[71516]:     </disk>
Apr 11 23:05:58 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:58 user nova-compute[71516]:       <mac address="fa:16:3e:50:71:df"/>
Apr 11 23:05:58 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:58 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:58 user nova-compute[71516]:       <target dev="tap5469ebfb-ee"/>
Apr 11 23:05:58 user nova-compute[71516]:     </interface>
Apr 11 23:05:58 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:58 user nova-compute[71516]:       <mac address="fa:16:3e:a6:4e:db"/>
Apr 11 23:05:58 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:58 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:58 user nova-compute[71516]:       <target dev="tapdd4aa184-e6"/>
Apr 11 23:05:58 user nova-compute[71516]:     </interface>
Apr 11 23:05:58 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:58 user nova-compute[71516]:       <mac address="fa:16:3e:ab:90:c1"/>
Apr 11 23:05:58 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:58 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:58 user nova-compute[71516]:       <target dev="tap94d3ede6-25"/>
Apr 11 23:05:58 user nova-compute[71516]:     </interface>
Apr 11 23:05:58 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:58 user nova-compute[71516]:       <mac address="fa:16:3e:5a:b7:bd"/>
Apr 11 23:05:58 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:58 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:58 user nova-compute[71516]:       <target dev="tap0dc3835d-01"/>
Apr 11 23:05:58 user nova-compute[71516]:     </interface>
Apr 11 23:05:58 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:58 user nova-compute[71516]:       <mac address="fa:16:3e:61:66:59"/>
Apr 11 23:05:58 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:58 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:58 user nova-compute[71516]:       <target dev="tapba2be13d-a0"/>
Apr 11 23:05:58 user nova-compute[71516]:     </interface>
Apr 11 23:05:58 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:58 user nova-compute[71516]:       <mac address="fa:16:3e:e8:60:34"/>
Apr 11 23:05:58 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:58 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:58 user nova-compute[71516]:       <target dev="tap7f3e80ab-f7"/>
Apr 11 23:05:58 user nova-compute[71516]:     </interface>
Apr 11 23:05:58 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:58 user nova-compute[71516]:       <mac address="fa:16:3e:ba:4c:27"/>
Apr 11 23:05:58 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:58 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:58 user nova-compute[71516]:       <target dev="tapdc64ce92-41"/>
Apr 11 23:05:58 user nova-compute[71516]:     </interface>
Apr 11 23:05:58 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:05:58 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/f59cffaa-b1e0-427d-b395-1043bad9a5c7/console.log" append="off"/>
Apr 11 23:05:58 user nova-compute[71516]:     </serial>
Apr 11 23:05:58 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:05:58 user nova-compute[71516]:     <video>
Apr 11 23:05:58 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:58 user nova-compute[71516]:     </video>
Apr 11 23:05:58 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:05:58 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:05:58 user nova-compute[71516]:     </rng>
Apr 11 23:05:58 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:05:58 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:05:58 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:05:58 user nova-compute[71516]:     </memballoon>
Apr 11 23:05:58 user nova-compute[71516]:   </devices>
Apr 11 23:05:58 user nova-compute[71516]: </domain>
Apr 11 23:05:58 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "address": "fa:16:3e:50:71:df", "network": {"id": "d9a27961-c537-4aa6-9fba-dbd50ba4d719", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1712790655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5469ebfb-ee", "ovs_interfaceid": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "address": "fa:16:3e:50:71:df", "network": {"id": "d9a27961-c537-4aa6-9fba-dbd50ba4d719", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1712790655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5469ebfb-ee", "ovs_interfaceid": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:71:df,bridge_name='br-int',has_traffic_filtering=True,id=5469ebfb-ee6b-49b3-9ae9-35423e6254a1,network=Network(d9a27961-c537-4aa6-9fba-dbd50ba4d719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5469ebfb-ee') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:71:df,bridge_name='br-int',has_traffic_filtering=True,id=5469ebfb-ee6b-49b3-9ae9-35423e6254a1,network=Network(d9a27961-c537-4aa6-9fba-dbd50ba4d719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5469ebfb-ee') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5469ebfb-ee, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5469ebfb-ee, col_values=(('external_ids', {'iface-id': '5469ebfb-ee6b-49b3-9ae9-35423e6254a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:71:df', 'vm-uuid': 'f59cffaa-b1e0-427d-b395-1043bad9a5c7'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dacf3c3-0a6c-4fff-96fc-ff36b04930dd]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: INFO os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:71:df,bridge_name='br-int',has_traffic_filtering=True,id=5469ebfb-ee6b-49b3-9ae9-35423e6254a1,network=Network(d9a27961-c537-4aa6-9fba-dbd50ba4d719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5469ebfb-ee')
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=dd4aa184-e61f-4c14-bb1e-04e2b5c139ac,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd4aa184-e6') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=dd4aa184-e61f-4c14-bb1e-04e2b5c139ac,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd4aa184-e6') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd4aa184-e6, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd4aa184-e6, col_values=(('external_ids', {'iface-id': 'dd4aa184-e61f-4c14-bb1e-04e2b5c139ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:4e:db', 'vm-uuid': 'f59cffaa-b1e0-427d-b395-1043bad9a5c7'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab408b8-1e1b-4a8c-b748-c98c780c9ea0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jisYQKLa {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: INFO os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=dd4aa184-e61f-4c14-bb1e-04e2b5c139ac,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd4aa184-e6')
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:90:c1,bridge_name='br-int',has_traffic_filtering=True,id=94d3ede6-25a2-498c-8b67-412a4b84272c,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94d3ede6-25') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:90:c1,bridge_name='br-int',has_traffic_filtering=True,id=94d3ede6-25a2-498c-8b67-412a4b84272c,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94d3ede6-25') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jisYQKLa" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5954d23e-50c9-4449-971f-2e3221c52622]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jisYQKLa'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94d3ede6-25, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94d3ede6-25, col_values=(('external_ids', {'iface-id': '94d3ede6-25a2-498c-8b67-412a4b84272c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:90:c1', 'vm-uuid': 'f59cffaa-b1e0-427d-b395-1043bad9a5c7'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3ec395-c32f-461e-9927-eb424fee63f8]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: INFO os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:90:c1,bridge_name='br-int',has_traffic_filtering=True,id=94d3ede6-25a2-498c-8b67-412a4b84272c,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94d3ede6-25')
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dc3835d-017b-4411-a70a-c538768a13b7", "address": "fa:16:3e:5a:b7:bd", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc3835d-01", "ovs_interfaceid": "0dc3835d-017b-4411-a70a-c538768a13b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "0dc3835d-017b-4411-a70a-c538768a13b7", "address": "fa:16:3e:5a:b7:bd", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc3835d-01", "ovs_interfaceid": "0dc3835d-017b-4411-a70a-c538768a13b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:b7:bd,bridge_name='br-int',has_traffic_filtering=True,id=0dc3835d-017b-4411-a70a-c538768a13b7,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc3835d-01') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:b7:bd,bridge_name='br-int',has_traffic_filtering=True,id=0dc3835d-017b-4411-a70a-c538768a13b7,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc3835d-01') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dc3835d-01, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0dc3835d-01, col_values=(('external_ids', {'iface-id': '0dc3835d-017b-4411-a70a-c538768a13b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:b7:bd', 'vm-uuid': 'f59cffaa-b1e0-427d-b395-1043bad9a5c7'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8316efca-77eb-4d44-a94a-e2db2a40e432]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: INFO os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:b7:bd,bridge_name='br-int',has_traffic_filtering=True,id=0dc3835d-017b-4411-a70a-c538768a13b7,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc3835d-01')
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:66:59,bridge_name='br-int',has_traffic_filtering=True,id=ba2be13d-a019-4ba5-8b60-ed888cf7699e,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2be13d-a0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:66:59,bridge_name='br-int',has_traffic_filtering=True,id=ba2be13d-a019-4ba5-8b60-ed888cf7699e,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2be13d-a0') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba2be13d-a0, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba2be13d-a0, col_values=(('external_ids', {'iface-id': 'ba2be13d-a019-4ba5-8b60-ed888cf7699e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:66:59', 'vm-uuid': 'f59cffaa-b1e0-427d-b395-1043bad9a5c7'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[938e5e46-eec0-4d86-b3fa-1906a441f126]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd, portal: 172.16.0.220,3260]
Apr 11 23:05:58 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd, portal: 172.16.0.220,3260] successful.
Apr 11 23:05:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: INFO os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:66:59,bridge_name='br-int',has_traffic_filtering=True,id=ba2be13d-a019-4ba5-8b60-ed888cf7699e,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2be13d-a0')
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:60:34,bridge_name='br-int',has_traffic_filtering=True,id=7f3e80ab-f7c2-4300-a599-eed29afc0e83,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3e80ab-f7') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:60:34,bridge_name='br-int',has_traffic_filtering=True,id=7f3e80ab-f7c2-4300-a599-eed29afc0e83,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3e80ab-f7') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd384c2-7a3c-4561-bb17-0084c64ee8c8]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f3e80ab-f7, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f3e80ab-f7, col_values=(('external_ids', {'iface-id': '7f3e80ab-f7c2-4300-a599-eed29afc0e83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:60:34', 'vm-uuid': 'f59cffaa-b1e0-427d-b395-1043bad9a5c7'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9772025a-b711-43a4-ba13-61c4a9769184]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:05:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:05:58 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:05:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: INFO os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:60:34,bridge_name='br-int',has_traffic_filtering=True,id=7f3e80ab-f7c2-4300-a599-eed29afc0e83,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3e80ab-f7')
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:4c:27,bridge_name='br-int',has_traffic_filtering=True,id=dc64ce92-4113-4d3c-85fd-46ac2058a479,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64ce92-41') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:4c:27,bridge_name='br-int',has_traffic_filtering=True,id=dc64ce92-4113-4d3c-85fd-46ac2058a479,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64ce92-41') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b059dc7d-bd29-4de3-904c-d754bd7b94e1]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jisYQKLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc64ce92-41, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc64ce92-41, col_values=(('external_ids', {'iface-id': 'dc64ce92-4113-4d3c-85fd-46ac2058a479', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:4c:27', 'vm-uuid': 'f59cffaa-b1e0-427d-b395-1043bad9a5c7'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:58 user nova-compute[71516]: INFO os_vif [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:4c:27,bridge_name='br-int',has_traffic_filtering=True,id=dc64ce92-4113-4d3c-85fd-46ac2058a479,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64ce92-41')
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] No BDM found with device name hda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] No VIF found with MAC fa:16:3e:50:71:df, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:05:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] No VIF found with MAC fa:16:3e:61:66:59, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:05:58 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Using config drive
Apr 11 23:05:59 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Creating config drive at /opt/stack/data/nova/instances/f59cffaa-b1e0-427d-b395-1043bad9a5c7/disk.config
Apr 11 23:05:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f59cffaa-b1e0-427d-b395-1043bad9a5c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfzevsg3b {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f59cffaa-b1e0-427d-b395-1043bad9a5c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfzevsg3b" returned: 0 in 0.069s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] <== connect_volume: return (2689ms) {'type': 'block', 'scsi_wwn': '23739316537643734', 'path': '/dev/sdh'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739316537643734', 'path': '/dev/sdh'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "address": "fa:16:3e:d7:2d:8b", "network": {"id": "a341e6d3-4f4c-44c5-a510-cd0b61eb81cd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-604450370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ff16a9-5f", "ovs_interfaceid": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "address": "fa:16:3e:d7:2d:8b", "network": {"id": "a341e6d3-4f4c-44c5-a510-cd0b61eb81cd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-604450370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ff16a9-5f", "ovs_interfaceid": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=53ff16a9-5f97-4d83-9b59-7ce5c337f392,network=Network(a341e6d3-4f4c-44c5-a510-cd0b61eb81cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ff16a9-5f') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:64:78,bridge_name='br-int',has_traffic_filtering=True,id=9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9486eb92-5c') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:fb:35,bridge_name='br-int',has_traffic_filtering=True,id=4f2220da-1007-4ae8-9c12-73a142b02b49,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f2220da-10') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:2b:54,bridge_name='br-int',has_traffic_filtering=True,id=86246915-cf00-43be-b433-01b4ed88252c,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86246915-cf') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:a5:c1,bridge_name='br-int',has_traffic_filtering=True,id=39a39a5d-8b30-4e73-893d-323dbde1de9f,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a39a5d-8b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5296123e-0b05-4e29-b252-6e2db7395f78", "address": "fa:16:3e:90:c9:63", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296123e-0b", "ovs_interfaceid": "5296123e-0b05-4e29-b252-6e2db7395f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "5296123e-0b05-4e29-b252-6e2db7395f78", "address": "fa:16:3e:90:c9:63", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296123e-0b", "ovs_interfaceid": "5296123e-0b05-4e29-b252-6e2db7395f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5296123e-0b05-4e29-b252-6e2db7395f78,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296123e-0b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:55:85,bridge_name='br-int',has_traffic_filtering=True,id=d29edb78-cc5a-4e48-81af-a915190376af,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29edb78-cc') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.objects.instance [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lazy-loading 'pci_devices' on Instance uuid 89644573-5fbc-4ab4-a16b-23b7c4f6c598 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:05:59 user nova-compute[71516]:   <uuid>89644573-5fbc-4ab4-a16b-23b7c4f6c598</uuid>
Apr 11 23:05:59 user nova-compute[71516]:   <name>instance-0000000a</name>
Apr 11 23:05:59 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:05:59 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:05:59 user nova-compute[71516]:   <metadata>
Apr 11 23:05:59 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:05:59 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:05:59 user nova-compute[71516]:       <nova:name>tempest-device-tagging-server-1545591213</nova:name>
Apr 11 23:05:59 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:05:52</nova:creationTime>
Apr 11 23:05:59 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:05:59 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:05:59 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:05:59 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:05:59 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:05:59 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:05:59 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:05:59 user nova-compute[71516]:       <nova:owner>
Apr 11 23:05:59 user nova-compute[71516]:         <nova:user uuid="a6c3f5f97f8d4380a97913a14fda79df">tempest-TaggedBootDevicesTest_v242-604376384-project-member</nova:user>
Apr 11 23:05:59 user nova-compute[71516]:         <nova:project uuid="d2ea0b8c8a4b4a1cac18e97464975fab">tempest-TaggedBootDevicesTest_v242-604376384</nova:project>
Apr 11 23:05:59 user nova-compute[71516]:       </nova:owner>
Apr 11 23:05:59 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:05:59 user nova-compute[71516]:       <nova:ports>
Apr 11 23:05:59 user nova-compute[71516]:         <nova:port uuid="53ff16a9-5f97-4d83-9b59-7ce5c337f392">
Apr 11 23:05:59 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 23:05:59 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:59 user nova-compute[71516]:         <nova:port uuid="9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660">
Apr 11 23:05:59 user nova-compute[71516]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Apr 11 23:05:59 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:59 user nova-compute[71516]:         <nova:port uuid="4f2220da-1007-4ae8-9c12-73a142b02b49">
Apr 11 23:05:59 user nova-compute[71516]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Apr 11 23:05:59 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:59 user nova-compute[71516]:         <nova:port uuid="86246915-cf00-43be-b433-01b4ed88252c">
Apr 11 23:05:59 user nova-compute[71516]:           <nova:ip type="fixed" address="10.1.1.7" ipVersion="4"/>
Apr 11 23:05:59 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:59 user nova-compute[71516]:         <nova:port uuid="39a39a5d-8b30-4e73-893d-323dbde1de9f">
Apr 11 23:05:59 user nova-compute[71516]:           <nova:ip type="fixed" address="10.1.1.6" ipVersion="4"/>
Apr 11 23:05:59 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:59 user nova-compute[71516]:         <nova:port uuid="5296123e-0b05-4e29-b252-6e2db7395f78">
Apr 11 23:05:59 user nova-compute[71516]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 23:05:59 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:59 user nova-compute[71516]:         <nova:port uuid="d29edb78-cc5a-4e48-81af-a915190376af">
Apr 11 23:05:59 user nova-compute[71516]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 23:05:59 user nova-compute[71516]:         </nova:port>
Apr 11 23:05:59 user nova-compute[71516]:       </nova:ports>
Apr 11 23:05:59 user nova-compute[71516]:     </nova:instance>
Apr 11 23:05:59 user nova-compute[71516]:   </metadata>
Apr 11 23:05:59 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:05:59 user nova-compute[71516]:     <system>
Apr 11 23:05:59 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:05:59 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:05:59 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:05:59 user nova-compute[71516]:       <entry name="serial">89644573-5fbc-4ab4-a16b-23b7c4f6c598</entry>
Apr 11 23:05:59 user nova-compute[71516]:       <entry name="uuid">89644573-5fbc-4ab4-a16b-23b7c4f6c598</entry>
Apr 11 23:05:59 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:05:59 user nova-compute[71516]:     </system>
Apr 11 23:05:59 user nova-compute[71516]:   </sysinfo>
Apr 11 23:05:59 user nova-compute[71516]:   <os>
Apr 11 23:05:59 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:05:59 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:05:59 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:05:59 user nova-compute[71516]:   </os>
Apr 11 23:05:59 user nova-compute[71516]:   <features>
Apr 11 23:05:59 user nova-compute[71516]:     <acpi/>
Apr 11 23:05:59 user nova-compute[71516]:     <apic/>
Apr 11 23:05:59 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:05:59 user nova-compute[71516]:   </features>
Apr 11 23:05:59 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:05:59 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:05:59 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:05:59 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:05:59 user nova-compute[71516]:   </clock>
Apr 11 23:05:59 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:05:59 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:05:59 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:05:59 user nova-compute[71516]:   </cpu>
Apr 11 23:05:59 user nova-compute[71516]:   <devices>
Apr 11 23:05:59 user nova-compute[71516]:     <disk type="file" device="cdrom">
Apr 11 23:05:59 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 23:05:59 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/89644573-5fbc-4ab4-a16b-23b7c4f6c598/disk.config"/>
Apr 11 23:05:59 user nova-compute[71516]:       <target dev="hda" bus="ide"/>
Apr 11 23:05:59 user nova-compute[71516]:     </disk>
Apr 11 23:05:59 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:05:59 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:05:59 user nova-compute[71516]:       <source dev="/dev/sdd"/>
Apr 11 23:05:59 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:05:59 user nova-compute[71516]:       <serial>2f3d8fb7-2270-4c7c-b1ef-63cb207587dc</serial>
Apr 11 23:05:59 user nova-compute[71516]:     </disk>
Apr 11 23:05:59 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:05:59 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:05:59 user nova-compute[71516]:       <source dev="/dev/sdf"/>
Apr 11 23:05:59 user nova-compute[71516]:       <target dev="vdb" bus="virtio"/>
Apr 11 23:05:59 user nova-compute[71516]:       <serial>6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a</serial>
Apr 11 23:05:59 user nova-compute[71516]:     </disk>
Apr 11 23:05:59 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:05:59 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:05:59 user nova-compute[71516]:       <source dev="/dev/sdh"/>
Apr 11 23:05:59 user nova-compute[71516]:       <target dev="vdc" bus="virtio"/>
Apr 11 23:05:59 user nova-compute[71516]:       <serial>39261de4-8b4d-4e01-b027-628663c9a7fd</serial>
Apr 11 23:05:59 user nova-compute[71516]:     </disk>
Apr 11 23:05:59 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:59 user nova-compute[71516]:       <mac address="fa:16:3e:d7:2d:8b"/>
Apr 11 23:05:59 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:59 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:59 user nova-compute[71516]:       <target dev="tap53ff16a9-5f"/>
Apr 11 23:05:59 user nova-compute[71516]:     </interface>
Apr 11 23:05:59 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:59 user nova-compute[71516]:       <mac address="fa:16:3e:a2:64:78"/>
Apr 11 23:05:59 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:59 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:59 user nova-compute[71516]:       <target dev="tap9486eb92-5c"/>
Apr 11 23:05:59 user nova-compute[71516]:     </interface>
Apr 11 23:05:59 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:59 user nova-compute[71516]:       <mac address="fa:16:3e:65:fb:35"/>
Apr 11 23:05:59 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:59 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:59 user nova-compute[71516]:       <target dev="tap4f2220da-10"/>
Apr 11 23:05:59 user nova-compute[71516]:     </interface>
Apr 11 23:05:59 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:59 user nova-compute[71516]:       <mac address="fa:16:3e:07:2b:54"/>
Apr 11 23:05:59 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:59 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:59 user nova-compute[71516]:       <target dev="tap86246915-cf"/>
Apr 11 23:05:59 user nova-compute[71516]:     </interface>
Apr 11 23:05:59 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:59 user nova-compute[71516]:       <mac address="fa:16:3e:68:a5:c1"/>
Apr 11 23:05:59 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:59 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:59 user nova-compute[71516]:       <target dev="tap39a39a5d-8b"/>
Apr 11 23:05:59 user nova-compute[71516]:     </interface>
Apr 11 23:05:59 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:59 user nova-compute[71516]:       <mac address="fa:16:3e:90:c9:63"/>
Apr 11 23:05:59 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:59 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:59 user nova-compute[71516]:       <target dev="tap5296123e-0b"/>
Apr 11 23:05:59 user nova-compute[71516]:     </interface>
Apr 11 23:05:59 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:05:59 user nova-compute[71516]:       <mac address="fa:16:3e:30:55:85"/>
Apr 11 23:05:59 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:59 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:05:59 user nova-compute[71516]:       <target dev="tapd29edb78-cc"/>
Apr 11 23:05:59 user nova-compute[71516]:     </interface>
Apr 11 23:05:59 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:05:59 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/89644573-5fbc-4ab4-a16b-23b7c4f6c598/console.log" append="off"/>
Apr 11 23:05:59 user nova-compute[71516]:     </serial>
Apr 11 23:05:59 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:05:59 user nova-compute[71516]:     <video>
Apr 11 23:05:59 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:05:59 user nova-compute[71516]:     </video>
Apr 11 23:05:59 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:05:59 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:05:59 user nova-compute[71516]:     </rng>
Apr 11 23:05:59 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:05:59 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:05:59 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:05:59 user nova-compute[71516]:     </memballoon>
Apr 11 23:05:59 user nova-compute[71516]:   </devices>
Apr 11 23:05:59 user nova-compute[71516]: </domain>
Apr 11 23:05:59 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "address": "fa:16:3e:d7:2d:8b", "network": {"id": "a341e6d3-4f4c-44c5-a510-cd0b61eb81cd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-604450370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ff16a9-5f", "ovs_interfaceid": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "address": "fa:16:3e:d7:2d:8b", "network": {"id": "a341e6d3-4f4c-44c5-a510-cd0b61eb81cd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-604450370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ff16a9-5f", "ovs_interfaceid": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=53ff16a9-5f97-4d83-9b59-7ce5c337f392,network=Network(a341e6d3-4f4c-44c5-a510-cd0b61eb81cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ff16a9-5f') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=53ff16a9-5f97-4d83-9b59-7ce5c337f392,network=Network(a341e6d3-4f4c-44c5-a510-cd0b61eb81cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ff16a9-5f') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53ff16a9-5f, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53ff16a9-5f, col_values=(('external_ids', {'iface-id': '53ff16a9-5f97-4d83-9b59-7ce5c337f392', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:2d:8b', 'vm-uuid': '89644573-5fbc-4ab4-a16b-23b7c4f6c598'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:59 user nova-compute[71516]: INFO os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=53ff16a9-5f97-4d83-9b59-7ce5c337f392,network=Network(a341e6d3-4f4c-44c5-a510-cd0b61eb81cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ff16a9-5f')
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:64:78,bridge_name='br-int',has_traffic_filtering=True,id=9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9486eb92-5c') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:64:78,bridge_name='br-int',has_traffic_filtering=True,id=9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9486eb92-5c') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9486eb92-5c, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9486eb92-5c, col_values=(('external_ids', {'iface-id': '9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:64:78', 'vm-uuid': '89644573-5fbc-4ab4-a16b-23b7c4f6c598'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:05:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: INFO os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:64:78,bridge_name='br-int',has_traffic_filtering=True,id=9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9486eb92-5c')
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:fb:35,bridge_name='br-int',has_traffic_filtering=True,id=4f2220da-1007-4ae8-9c12-73a142b02b49,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f2220da-10') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:fb:35,bridge_name='br-int',has_traffic_filtering=True,id=4f2220da-1007-4ae8-9c12-73a142b02b49,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f2220da-10') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f2220da-10, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f2220da-10, col_values=(('external_ids', {'iface-id': '4f2220da-1007-4ae8-9c12-73a142b02b49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:fb:35', 'vm-uuid': '89644573-5fbc-4ab4-a16b-23b7c4f6c598'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: INFO os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:fb:35,bridge_name='br-int',has_traffic_filtering=True,id=4f2220da-1007-4ae8-9c12-73a142b02b49,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f2220da-10')
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:2b:54,bridge_name='br-int',has_traffic_filtering=True,id=86246915-cf00-43be-b433-01b4ed88252c,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86246915-cf') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:2b:54,bridge_name='br-int',has_traffic_filtering=True,id=86246915-cf00-43be-b433-01b4ed88252c,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86246915-cf') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86246915-cf, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86246915-cf, col_values=(('external_ids', {'iface-id': '86246915-cf00-43be-b433-01b4ed88252c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:2b:54', 'vm-uuid': '89644573-5fbc-4ab4-a16b-23b7c4f6c598'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: INFO os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:2b:54,bridge_name='br-int',has_traffic_filtering=True,id=86246915-cf00-43be-b433-01b4ed88252c,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86246915-cf')
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:a5:c1,bridge_name='br-int',has_traffic_filtering=True,id=39a39a5d-8b30-4e73-893d-323dbde1de9f,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a39a5d-8b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a5:c1,bridge_name='br-int',has_traffic_filtering=True,id=39a39a5d-8b30-4e73-893d-323dbde1de9f,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a39a5d-8b') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39a39a5d-8b, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39a39a5d-8b, col_values=(('external_ids', {'iface-id': '39a39a5d-8b30-4e73-893d-323dbde1de9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:a5:c1', 'vm-uuid': '89644573-5fbc-4ab4-a16b-23b7c4f6c598'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: INFO os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a5:c1,bridge_name='br-int',has_traffic_filtering=True,id=39a39a5d-8b30-4e73-893d-323dbde1de9f,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a39a5d-8b')
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5296123e-0b05-4e29-b252-6e2db7395f78", "address": "fa:16:3e:90:c9:63", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296123e-0b", "ovs_interfaceid": "5296123e-0b05-4e29-b252-6e2db7395f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "5296123e-0b05-4e29-b252-6e2db7395f78", "address": "fa:16:3e:90:c9:63", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296123e-0b", "ovs_interfaceid": "5296123e-0b05-4e29-b252-6e2db7395f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5296123e-0b05-4e29-b252-6e2db7395f78,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296123e-0b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5296123e-0b05-4e29-b252-6e2db7395f78,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296123e-0b') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5296123e-0b, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5296123e-0b, col_values=(('external_ids', {'iface-id': '5296123e-0b05-4e29-b252-6e2db7395f78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:c9:63', 'vm-uuid': '89644573-5fbc-4ab4-a16b-23b7c4f6c598'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: INFO os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5296123e-0b05-4e29-b252-6e2db7395f78,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296123e-0b')
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:55:85,bridge_name='br-int',has_traffic_filtering=True,id=d29edb78-cc5a-4e48-81af-a915190376af,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29edb78-cc') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:55:85,bridge_name='br-int',has_traffic_filtering=True,id=d29edb78-cc5a-4e48-81af-a915190376af,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29edb78-cc') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd29edb78-cc, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd29edb78-cc, col_values=(('external_ids', {'iface-id': 'd29edb78-cc5a-4e48-81af-a915190376af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:55:85', 'vm-uuid': '89644573-5fbc-4ab4-a16b-23b7c4f6c598'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: INFO os_vif [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:55:85,bridge_name='br-int',has_traffic_filtering=True,id=d29edb78-cc5a-4e48-81af-a915190376af,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29edb78-cc')
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] No BDM found with device name hda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] No VIF found with MAC fa:16:3e:d7:2d:8b, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] No VIF found with MAC fa:16:3e:68:a5:c1, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:06:00 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Using config drive
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:00 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Creating config drive at /opt/stack/data/nova/instances/89644573-5fbc-4ab4-a16b-23b7c4f6c598/disk.config
Apr 11 23:06:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/89644573-5fbc-4ab4-a16b-23b7c4f6c598/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdpuep63v {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/89644573-5fbc-4ab4-a16b-23b7c4f6c598/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdpuep63v" returned: 0 in 0.058s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-9e034369-236b-4e21-9fae-dab87745c7c7 req-474002ce-f8d2-4dba-aac2-a0cb35649f94 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9e034369-236b-4e21-9fae-dab87745c7c7 req-474002ce-f8d2-4dba-aac2-a0cb35649f94 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9e034369-236b-4e21-9fae-dab87745c7c7 req-474002ce-f8d2-4dba-aac2-a0cb35649f94 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9e034369-236b-4e21-9fae-dab87745c7c7 req-474002ce-f8d2-4dba-aac2-a0cb35649f94 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-9e034369-236b-4e21-9fae-dab87745c7c7 req-474002ce-f8d2-4dba-aac2-a0cb35649f94 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:01 user nova-compute[71516]: WARNING nova.compute.manager [req-9e034369-236b-4e21-9fae-dab87745c7c7 req-474002ce-f8d2-4dba-aac2-a0cb35649f94 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 for instance with vm_state building and task_state spawning.
Apr 11 23:06:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-ff5b7e5d-4d5e-46db-bd5d-3f314373989e req-5f571e17-3900-4138-9c83-2f4f4dabff9c service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ff5b7e5d-4d5e-46db-bd5d-3f314373989e req-5f571e17-3900-4138-9c83-2f4f4dabff9c service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ff5b7e5d-4d5e-46db-bd5d-3f314373989e req-5f571e17-3900-4138-9c83-2f4f4dabff9c service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ff5b7e5d-4d5e-46db-bd5d-3f314373989e req-5f571e17-3900-4138-9c83-2f4f4dabff9c service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-ff5b7e5d-4d5e-46db-bd5d-3f314373989e req-5f571e17-3900-4138-9c83-2f4f4dabff9c service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:01 user nova-compute[71516]: WARNING nova.compute.manager [req-ff5b7e5d-4d5e-46db-bd5d-3f314373989e req-5f571e17-3900-4138-9c83-2f4f4dabff9c service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac for instance with vm_state building and task_state spawning.
Apr 11 23:06:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-5f9644f5-a97a-4b24-a6b4-eaa2c778e655 req-8c2d9ef2-5259-434a-afca-34ae4a4c3b05 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5f9644f5-a97a-4b24-a6b4-eaa2c778e655 req-8c2d9ef2-5259-434a-afca-34ae4a4c3b05 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5f9644f5-a97a-4b24-a6b4-eaa2c778e655 req-8c2d9ef2-5259-434a-afca-34ae4a4c3b05 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5f9644f5-a97a-4b24-a6b4-eaa2c778e655 req-8c2d9ef2-5259-434a-afca-34ae4a4c3b05 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-5f9644f5-a97a-4b24-a6b4-eaa2c778e655 req-8c2d9ef2-5259-434a-afca-34ae4a4c3b05 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:03 user nova-compute[71516]: WARNING nova.compute.manager [req-5f9644f5-a97a-4b24-a6b4-eaa2c778e655 req-8c2d9ef2-5259-434a-afca-34ae4a4c3b05 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 for instance with vm_state building and task_state spawning.
Apr 11 23:06:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:03 user nova-compute[71516]: WARNING nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac for instance with vm_state building and task_state spawning.
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-94d3ede6-25a2-498c-8b67-412a4b84272c {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-94d3ede6-25a2-498c-8b67-412a4b84272c {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:03 user nova-compute[71516]: WARNING nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-94d3ede6-25a2-498c-8b67-412a4b84272c for instance with vm_state building and task_state spawning.
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-94d3ede6-25a2-498c-8b67-412a4b84272c {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-94d3ede6-25a2-498c-8b67-412a4b84272c {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:03 user nova-compute[71516]: WARNING nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-94d3ede6-25a2-498c-8b67-412a4b84272c for instance with vm_state building and task_state spawning.
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-0dc3835d-017b-4411-a70a-c538768a13b7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-0dc3835d-017b-4411-a70a-c538768a13b7 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:03 user nova-compute[71516]: WARNING nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-0dc3835d-017b-4411-a70a-c538768a13b7 for instance with vm_state building and task_state spawning.
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-0dc3835d-017b-4411-a70a-c538768a13b7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-0dc3835d-017b-4411-a70a-c538768a13b7 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:03 user nova-compute[71516]: WARNING nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-0dc3835d-017b-4411-a70a-c538768a13b7 for instance with vm_state building and task_state spawning.
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-ba2be13d-a019-4ba5-8b60-ed888cf7699e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-ba2be13d-a019-4ba5-8b60-ed888cf7699e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:03 user nova-compute[71516]: WARNING nova.compute.manager [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-ba2be13d-a019-4ba5-8b60-ed888cf7699e for instance with vm_state building and task_state spawning.
Apr 11 23:06:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-7f3e80ab-f7c2-4300-a599-eed29afc0e83 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-7f3e80ab-f7c2-4300-a599-eed29afc0e83 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:05 user nova-compute[71516]: WARNING nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-7f3e80ab-f7c2-4300-a599-eed29afc0e83 for instance with vm_state building and task_state spawning.
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-7f3e80ab-f7c2-4300-a599-eed29afc0e83 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-7f3e80ab-f7c2-4300-a599-eed29afc0e83 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:05 user nova-compute[71516]: WARNING nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-7f3e80ab-f7c2-4300-a599-eed29afc0e83 for instance with vm_state building and task_state spawning.
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:05 user nova-compute[71516]: WARNING nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 for instance with vm_state building and task_state spawning.
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:05 user nova-compute[71516]: WARNING nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 for instance with vm_state building and task_state spawning.
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-dc64ce92-4113-4d3c-85fd-46ac2058a479 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-dc64ce92-4113-4d3c-85fd-46ac2058a479 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:05 user nova-compute[71516]: WARNING nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-dc64ce92-4113-4d3c-85fd-46ac2058a479 for instance with vm_state building and task_state spawning.
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-dc64ce92-4113-4d3c-85fd-46ac2058a479 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-dc64ce92-4113-4d3c-85fd-46ac2058a479 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:05 user nova-compute[71516]: WARNING nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-dc64ce92-4113-4d3c-85fd-46ac2058a479 for instance with vm_state building and task_state spawning.
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-4f2220da-1007-4ae8-9c12-73a142b02b49 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-4f2220da-1007-4ae8-9c12-73a142b02b49 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:05 user nova-compute[71516]: WARNING nova.compute.manager [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-4f2220da-1007-4ae8-9c12-73a142b02b49 for instance with vm_state building and task_state spawning.
Apr 11 23:06:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-e4a72402-764b-41c1-b859-dce2b47a4df4 req-8b337f86-06be-4a80-8527-a0bcb23a2e0e service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-86246915-cf00-43be-b433-01b4ed88252c {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e4a72402-764b-41c1-b859-dce2b47a4df4 req-8b337f86-06be-4a80-8527-a0bcb23a2e0e service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e4a72402-764b-41c1-b859-dce2b47a4df4 req-8b337f86-06be-4a80-8527-a0bcb23a2e0e service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e4a72402-764b-41c1-b859-dce2b47a4df4 req-8b337f86-06be-4a80-8527-a0bcb23a2e0e service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-e4a72402-764b-41c1-b859-dce2b47a4df4 req-8b337f86-06be-4a80-8527-a0bcb23a2e0e service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-86246915-cf00-43be-b433-01b4ed88252c {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:05 user nova-compute[71516]: WARNING nova.compute.manager [req-e4a72402-764b-41c1-b859-dce2b47a4df4 req-8b337f86-06be-4a80-8527-a0bcb23a2e0e service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-86246915-cf00-43be-b433-01b4ed88252c for instance with vm_state building and task_state spawning.
Apr 11 23:06:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-ba2be13d-a019-4ba5-8b60-ed888cf7699e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-ba2be13d-a019-4ba5-8b60-ed888cf7699e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:05 user nova-compute[71516]: WARNING nova.compute.manager [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-ba2be13d-a019-4ba5-8b60-ed888cf7699e for instance with vm_state building and task_state spawning.
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:05 user nova-compute[71516]: WARNING nova.compute.manager [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-53ff16a9-5f97-4d83-9b59-7ce5c337f392 for instance with vm_state building and task_state spawning.
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:05 user nova-compute[71516]: WARNING nova.compute.manager [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-53ff16a9-5f97-4d83-9b59-7ce5c337f392 for instance with vm_state building and task_state spawning.
Apr 11 23:06:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-182d8831-a6c9-411f-b607-0c7a6fbe4f0b req-46275e19-cc04-4212-99a9-05c4937b3511 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-4f2220da-1007-4ae8-9c12-73a142b02b49 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-182d8831-a6c9-411f-b607-0c7a6fbe4f0b req-46275e19-cc04-4212-99a9-05c4937b3511 service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-182d8831-a6c9-411f-b607-0c7a6fbe4f0b req-46275e19-cc04-4212-99a9-05c4937b3511 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-182d8831-a6c9-411f-b607-0c7a6fbe4f0b req-46275e19-cc04-4212-99a9-05c4937b3511 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-182d8831-a6c9-411f-b607-0c7a6fbe4f0b req-46275e19-cc04-4212-99a9-05c4937b3511 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-4f2220da-1007-4ae8-9c12-73a142b02b49 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:07 user nova-compute[71516]: WARNING nova.compute.manager [req-182d8831-a6c9-411f-b607-0c7a6fbe4f0b req-46275e19-cc04-4212-99a9-05c4937b3511 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-4f2220da-1007-4ae8-9c12-73a142b02b49 for instance with vm_state building and task_state spawning.
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d8397eee-9634-454f-b407-a08d2abd6a55 req-1bbeda56-f8e5-4141-86ec-743843dd4ac1 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-86246915-cf00-43be-b433-01b4ed88252c {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d8397eee-9634-454f-b407-a08d2abd6a55 req-1bbeda56-f8e5-4141-86ec-743843dd4ac1 service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d8397eee-9634-454f-b407-a08d2abd6a55 req-1bbeda56-f8e5-4141-86ec-743843dd4ac1 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d8397eee-9634-454f-b407-a08d2abd6a55 req-1bbeda56-f8e5-4141-86ec-743843dd4ac1 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d8397eee-9634-454f-b407-a08d2abd6a55 req-1bbeda56-f8e5-4141-86ec-743843dd4ac1 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-86246915-cf00-43be-b433-01b4ed88252c {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:07 user nova-compute[71516]: WARNING nova.compute.manager [req-d8397eee-9634-454f-b407-a08d2abd6a55 req-1bbeda56-f8e5-4141-86ec-743843dd4ac1 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-86246915-cf00-43be-b433-01b4ed88252c for instance with vm_state building and task_state spawning.
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254367.795914, f59cffaa-b1e0-427d-b395-1043bad9a5c7 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:06:07 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] VM Resumed (Lifecycle Event)
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:06:07 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Instance spawned successfully.
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-39a39a5d-8b30-4e73-893d-323dbde1de9f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-39a39a5d-8b30-4e73-893d-323dbde1de9f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:07 user nova-compute[71516]: WARNING nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-39a39a5d-8b30-4e73-893d-323dbde1de9f for instance with vm_state building and task_state spawning.
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-39a39a5d-8b30-4e73-893d-323dbde1de9f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-39a39a5d-8b30-4e73-893d-323dbde1de9f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:07 user nova-compute[71516]: WARNING nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-39a39a5d-8b30-4e73-893d-323dbde1de9f for instance with vm_state building and task_state spawning.
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-5296123e-0b05-4e29-b252-6e2db7395f78 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-5296123e-0b05-4e29-b252-6e2db7395f78 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:07 user nova-compute[71516]: WARNING nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-5296123e-0b05-4e29-b252-6e2db7395f78 for instance with vm_state building and task_state spawning.
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-5296123e-0b05-4e29-b252-6e2db7395f78 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-5296123e-0b05-4e29-b252-6e2db7395f78 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:07 user nova-compute[71516]: WARNING nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-5296123e-0b05-4e29-b252-6e2db7395f78 for instance with vm_state building and task_state spawning.
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-d29edb78-cc5a-4e48-81af-a915190376af {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-d29edb78-cc5a-4e48-81af-a915190376af {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:07 user nova-compute[71516]: WARNING nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-d29edb78-cc5a-4e48-81af-a915190376af for instance with vm_state building and task_state spawning.
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-d29edb78-cc5a-4e48-81af-a915190376af {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-d29edb78-cc5a-4e48-81af-a915190376af {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:07 user nova-compute[71516]: WARNING nova.compute.manager [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-d29edb78-cc5a-4e48-81af-a915190376af for instance with vm_state building and task_state spawning.
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:07 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254367.802609, f59cffaa-b1e0-427d-b395-1043bad9a5c7 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:06:07 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] VM Started (Lifecycle Event)
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:06:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:06:07 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:06:08 user nova-compute[71516]: INFO nova.compute.manager [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Took 18.65 seconds to spawn the instance on the hypervisor.
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:06:08 user nova-compute[71516]: INFO nova.compute.manager [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Took 36.17 seconds to build instance.
Apr 11 23:06:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.290s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254368.572077, 89644573-5fbc-4ab4-a16b-23b7c4f6c598 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:06:08 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] VM Resumed (Lifecycle Event)
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:06:08 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Instance spawned successfully.
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:08 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254368.5751638, 89644573-5fbc-4ab4-a16b-23b7c4f6c598 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:06:08 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] VM Started (Lifecycle Event)
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:06:08 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:06:08 user nova-compute[71516]: INFO nova.compute.manager [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Took 19.05 seconds to spawn the instance on the hypervisor.
Apr 11 23:06:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:06:08 user nova-compute[71516]: INFO nova.compute.manager [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Took 37.30 seconds to build instance.
Apr 11 23:06:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.413s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:21 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:06:23 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:06:23 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:06:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:06:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:06:23 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:06:23 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating instance_info_cache with network_info: [{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:06:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:06:23 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:06:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:06:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:06:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:25 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:06:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:06:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:29 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:06:29 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=7278MB free_disk=26.502540588378906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 4f95b120-0c70-45a5-969f-c1728c72d420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 8322b884-2831-48af-a67e-26c31c17f49f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 902899b9-8c8f-404e-a110-832b3c91d526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f79fcca6-9f11-498f-b580-5681f9589a77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:06:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:30 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:06:30 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:06:30 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:06:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:06:33 user nova-compute[71516]: INFO nova.compute.claims [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Claim successful on node user
Apr 11 23:06:33 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG nova.network.neutron [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:06:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:06:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG nova.policy [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '859ae6c19707455ebf82bf532c9e10c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3e11fd040149dd8f5a130a9682a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:06:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:06:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Creating image(s)
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "/opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "/opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "/opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.153s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk 1073741824" returned: 0 in 0.047s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Cannot resize image /opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG nova.objects.instance [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lazy-loading 'migration_context' on Instance uuid 11799d90-83b6-4553-9a8f-287fdbb3cf3a {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Ensure instance console log exists: /opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Successfully created port: 7119bc80-98eb-47d6-b1b7-3ad91cae4256 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:06:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-changed-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Refreshing instance network info cache due to event network-changed-961d8195-c0d7-49eb-bfd7-05ee4b3e6112. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:06:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] Acquiring lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:06:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] Acquired lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:06:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Refreshing network info cache for port 961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:06:36 user nova-compute[71516]: DEBUG nova.network.neutron [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Successfully updated port: 7119bc80-98eb-47d6-b1b7-3ad91cae4256 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:06:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "refresh_cache-11799d90-83b6-4553-9a8f-287fdbb3cf3a" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:06:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquired lock "refresh_cache-11799d90-83b6-4553-9a8f-287fdbb3cf3a" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:06:36 user nova-compute[71516]: DEBUG nova.network.neutron [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:06:36 user nova-compute[71516]: DEBUG nova.network.neutron [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.network.neutron [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updated VIF entry in instance network info cache for port 961d8195-c0d7-49eb-bfd7-05ee4b3e6112. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.network.neutron [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating instance_info_cache with network_info: [{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] Releasing lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.network.neutron [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Updating instance_info_cache with network_info: [{"id": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "address": "fa:16:3e:83:f3:11", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7119bc80-98", "ovs_interfaceid": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Releasing lock "refresh_cache-11799d90-83b6-4553-9a8f-287fdbb3cf3a" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Instance network_info: |[{"id": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "address": "fa:16:3e:83:f3:11", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7119bc80-98", "ovs_interfaceid": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Start _get_guest_xml network_info=[{"id": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "address": "fa:16:3e:83:f3:11", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7119bc80-98", "ovs_interfaceid": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:06:37 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:06:37 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1375177297',display_name='tempest-ServersNegativeTestJSON-server-1375177297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1375177297',id=12,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c3e11fd040149dd8f5a130a9682a59c',ramdisk_id='',reservation_id='r-0xfj0j23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1318055293',owner_user_name='tempest-ServersNegativeTestJSON-1318055293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:06:34Z,user_data=None,user_id='859ae6c19707455ebf82bf532c9e10c0',uuid=11799d90-83b6-4553-9a8f-287fdbb3cf3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "address": "fa:16:3e:83:f3:11", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7119bc80-98", "ovs_interfaceid": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Converting VIF {"id": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "address": "fa:16:3e:83:f3:11", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7119bc80-98", "ovs_interfaceid": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f3:11,bridge_name='br-int',has_traffic_filtering=True,id=7119bc80-98eb-47d6-b1b7-3ad91cae4256,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7119bc80-98') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.objects.instance [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lazy-loading 'pci_devices' on Instance uuid 11799d90-83b6-4553-9a8f-287fdbb3cf3a {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:06:37 user nova-compute[71516]:   <uuid>11799d90-83b6-4553-9a8f-287fdbb3cf3a</uuid>
Apr 11 23:06:37 user nova-compute[71516]:   <name>instance-0000000c</name>
Apr 11 23:06:37 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:06:37 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:06:37 user nova-compute[71516]:   <metadata>
Apr 11 23:06:37 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:06:37 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:06:37 user nova-compute[71516]:       <nova:name>tempest-ServersNegativeTestJSON-server-1375177297</nova:name>
Apr 11 23:06:37 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:06:37</nova:creationTime>
Apr 11 23:06:37 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:06:37 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:06:37 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:06:37 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:06:37 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:06:37 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:06:37 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:06:37 user nova-compute[71516]:       <nova:owner>
Apr 11 23:06:37 user nova-compute[71516]:         <nova:user uuid="859ae6c19707455ebf82bf532c9e10c0">tempest-ServersNegativeTestJSON-1318055293-project-member</nova:user>
Apr 11 23:06:37 user nova-compute[71516]:         <nova:project uuid="4c3e11fd040149dd8f5a130a9682a59c">tempest-ServersNegativeTestJSON-1318055293</nova:project>
Apr 11 23:06:37 user nova-compute[71516]:       </nova:owner>
Apr 11 23:06:37 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:06:37 user nova-compute[71516]:       <nova:ports>
Apr 11 23:06:37 user nova-compute[71516]:         <nova:port uuid="7119bc80-98eb-47d6-b1b7-3ad91cae4256">
Apr 11 23:06:37 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:06:37 user nova-compute[71516]:         </nova:port>
Apr 11 23:06:37 user nova-compute[71516]:       </nova:ports>
Apr 11 23:06:37 user nova-compute[71516]:     </nova:instance>
Apr 11 23:06:37 user nova-compute[71516]:   </metadata>
Apr 11 23:06:37 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:06:37 user nova-compute[71516]:     <system>
Apr 11 23:06:37 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:06:37 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:06:37 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:06:37 user nova-compute[71516]:       <entry name="serial">11799d90-83b6-4553-9a8f-287fdbb3cf3a</entry>
Apr 11 23:06:37 user nova-compute[71516]:       <entry name="uuid">11799d90-83b6-4553-9a8f-287fdbb3cf3a</entry>
Apr 11 23:06:37 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:06:37 user nova-compute[71516]:     </system>
Apr 11 23:06:37 user nova-compute[71516]:   </sysinfo>
Apr 11 23:06:37 user nova-compute[71516]:   <os>
Apr 11 23:06:37 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:06:37 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:06:37 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:06:37 user nova-compute[71516]:   </os>
Apr 11 23:06:37 user nova-compute[71516]:   <features>
Apr 11 23:06:37 user nova-compute[71516]:     <acpi/>
Apr 11 23:06:37 user nova-compute[71516]:     <apic/>
Apr 11 23:06:37 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:06:37 user nova-compute[71516]:   </features>
Apr 11 23:06:37 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:06:37 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:06:37 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:06:37 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:06:37 user nova-compute[71516]:   </clock>
Apr 11 23:06:37 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:06:37 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:06:37 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:06:37 user nova-compute[71516]:   </cpu>
Apr 11 23:06:37 user nova-compute[71516]:   <devices>
Apr 11 23:06:37 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:06:37 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:06:37 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk"/>
Apr 11 23:06:37 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:06:37 user nova-compute[71516]:     </disk>
Apr 11 23:06:37 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:06:37 user nova-compute[71516]:       <mac address="fa:16:3e:83:f3:11"/>
Apr 11 23:06:37 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:06:37 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:06:37 user nova-compute[71516]:       <target dev="tap7119bc80-98"/>
Apr 11 23:06:37 user nova-compute[71516]:     </interface>
Apr 11 23:06:37 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:06:37 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/console.log" append="off"/>
Apr 11 23:06:37 user nova-compute[71516]:     </serial>
Apr 11 23:06:37 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:06:37 user nova-compute[71516]:     <video>
Apr 11 23:06:37 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:06:37 user nova-compute[71516]:     </video>
Apr 11 23:06:37 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:06:37 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:06:37 user nova-compute[71516]:     </rng>
Apr 11 23:06:37 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:06:37 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:06:37 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:06:37 user nova-compute[71516]:     </memballoon>
Apr 11 23:06:37 user nova-compute[71516]:   </devices>
Apr 11 23:06:37 user nova-compute[71516]: </domain>
Apr 11 23:06:37 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1375177297',display_name='tempest-ServersNegativeTestJSON-server-1375177297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1375177297',id=12,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c3e11fd040149dd8f5a130a9682a59c',ramdisk_id='',reservation_id='r-0xfj0j23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1318055293',owner_user_name='tempest-ServersNegativeTestJSON-1318055293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:06:34Z,user_data=None,user_id='859ae6c19707455ebf82bf532c9e10c0',uuid=11799d90-83b6-4553-9a8f-287fdbb3cf3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "address": "fa:16:3e:83:f3:11", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7119bc80-98", "ovs_interfaceid": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Converting VIF {"id": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "address": "fa:16:3e:83:f3:11", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7119bc80-98", "ovs_interfaceid": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f3:11,bridge_name='br-int',has_traffic_filtering=True,id=7119bc80-98eb-47d6-b1b7-3ad91cae4256,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7119bc80-98') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG os_vif [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f3:11,bridge_name='br-int',has_traffic_filtering=True,id=7119bc80-98eb-47d6-b1b7-3ad91cae4256,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7119bc80-98') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7119bc80-98, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7119bc80-98, col_values=(('external_ids', {'iface-id': '7119bc80-98eb-47d6-b1b7-3ad91cae4256', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:f3:11', 'vm-uuid': '11799d90-83b6-4553-9a8f-287fdbb3cf3a'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:37 user nova-compute[71516]: INFO os_vif [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f3:11,bridge_name='br-int',has_traffic_filtering=True,id=7119bc80-98eb-47d6-b1b7-3ad91cae4256,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7119bc80-98')
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:06:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] No VIF found with MAC fa:16:3e:83:f3:11, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Received event network-changed-7119bc80-98eb-47d6-b1b7-3ad91cae4256 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Refreshing instance network info cache due to event network-changed-7119bc80-98eb-47d6-b1b7-3ad91cae4256. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] Acquiring lock "refresh_cache-11799d90-83b6-4553-9a8f-287fdbb3cf3a" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] Acquired lock "refresh_cache-11799d90-83b6-4553-9a8f-287fdbb3cf3a" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG nova.network.neutron [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Refreshing network info cache for port 7119bc80-98eb-47d6-b1b7-3ad91cae4256 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-changed-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Refreshing instance network info cache due to event network-changed-7a130357-a93e-4aad-8404-d4b5b8dd7022. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] Acquiring lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] Acquired lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG nova.network.neutron [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Refreshing network info cache for port 7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG nova.network.neutron [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Updated VIF entry in instance network info cache for port 7119bc80-98eb-47d6-b1b7-3ad91cae4256. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG nova.network.neutron [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Updating instance_info_cache with network_info: [{"id": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "address": "fa:16:3e:83:f3:11", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7119bc80-98", "ovs_interfaceid": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] Releasing lock "refresh_cache-11799d90-83b6-4553-9a8f-287fdbb3cf3a" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG nova.network.neutron [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updated VIF entry in instance network info cache for port 7a130357-a93e-4aad-8404-d4b5b8dd7022. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG nova.network.neutron [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updating instance_info_cache with network_info: [{"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-941a22f0-b07a-4f2d-b17d-6a1b47c024f6 req-c2f3ee75-5f4d-421f-802b-4ef8e7c9e081 service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Received event network-vif-plugged-7119bc80-98eb-47d6-b1b7-3ad91cae4256 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-941a22f0-b07a-4f2d-b17d-6a1b47c024f6 req-c2f3ee75-5f4d-421f-802b-4ef8e7c9e081 service nova] Acquiring lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-941a22f0-b07a-4f2d-b17d-6a1b47c024f6 req-c2f3ee75-5f4d-421f-802b-4ef8e7c9e081 service nova] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-941a22f0-b07a-4f2d-b17d-6a1b47c024f6 req-c2f3ee75-5f4d-421f-802b-4ef8e7c9e081 service nova] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-941a22f0-b07a-4f2d-b17d-6a1b47c024f6 req-c2f3ee75-5f4d-421f-802b-4ef8e7c9e081 service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] No waiting events found dispatching network-vif-plugged-7119bc80-98eb-47d6-b1b7-3ad91cae4256 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:38 user nova-compute[71516]: WARNING nova.compute.manager [req-941a22f0-b07a-4f2d-b17d-6a1b47c024f6 req-c2f3ee75-5f4d-421f-802b-4ef8e7c9e081 service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Received unexpected event network-vif-plugged-7119bc80-98eb-47d6-b1b7-3ad91cae4256 for instance with vm_state building and task_state spawning.
Apr 11 23:06:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] Releasing lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:06:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:06:39 user nova-compute[71516]: INFO nova.compute.manager [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] instance snapshotting
Apr 11 23:06:39 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Beginning live snapshot process
Apr 11 23:06:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json -f qcow2 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json -f qcow2" returned: 0 in 0.164s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json -f qcow2 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.130s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwkcz0hla/e694105bc77f4dd09e9949c45bba8853.delta 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwkcz0hla/e694105bc77f4dd09e9949c45bba8853.delta 1073741824" returned: 0 in 0.048s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:40 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71516) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 11 23:06:40 user nova-compute[71516]: INFO nova.virt.libvirt.host [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] UEFI support detected
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254400.788534, 11799d90-83b6-4553-9a8f-287fdbb3cf3a => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:06:40 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] VM Resumed (Lifecycle Event)
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:06:40 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Instance spawned successfully.
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:06:40 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254400.7908304, 11799d90-83b6-4553-9a8f-287fdbb3cf3a => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:06:40 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] VM Started (Lifecycle Event)
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:06:40 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:06:40 user nova-compute[71516]: INFO nova.compute.manager [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Took 6.96 seconds to spawn the instance on the hypervisor.
Apr 11 23:06:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:06:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-5d6941c2-0b08-429f-a6c1-70dcf355ffb1 req-af277acb-e4ac-45a3-b484-92759141b1f8 service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Received event network-vif-plugged-7119bc80-98eb-47d6-b1b7-3ad91cae4256 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5d6941c2-0b08-429f-a6c1-70dcf355ffb1 req-af277acb-e4ac-45a3-b484-92759141b1f8 service nova] Acquiring lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5d6941c2-0b08-429f-a6c1-70dcf355ffb1 req-af277acb-e4ac-45a3-b484-92759141b1f8 service nova] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5d6941c2-0b08-429f-a6c1-70dcf355ffb1 req-af277acb-e4ac-45a3-b484-92759141b1f8 service nova] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-5d6941c2-0b08-429f-a6c1-70dcf355ffb1 req-af277acb-e4ac-45a3-b484-92759141b1f8 service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] No waiting events found dispatching network-vif-plugged-7119bc80-98eb-47d6-b1b7-3ad91cae4256 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:41 user nova-compute[71516]: WARNING nova.compute.manager [req-5d6941c2-0b08-429f-a6c1-70dcf355ffb1 req-af277acb-e4ac-45a3-b484-92759141b1f8 service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Received unexpected event network-vif-plugged-7119bc80-98eb-47d6-b1b7-3ad91cae4256 for instance with vm_state building and task_state spawning.
Apr 11 23:06:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:06:41 user nova-compute[71516]: INFO nova.compute.manager [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Took 7.73 seconds to build instance.
Apr 11 23:06:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.831s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:06:41 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 23:06:41 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:06:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwkcz0hla/e694105bc77f4dd09e9949c45bba8853.delta /opt/stack/data/nova/instances/snapshots/tmpwkcz0hla/e694105bc77f4dd09e9949c45bba8853 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwkcz0hla/e694105bc77f4dd09e9949c45bba8853.delta /opt/stack/data/nova/instances/snapshots/tmpwkcz0hla/e694105bc77f4dd09e9949c45bba8853" returned: 0 in 0.436s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Snapshot extracted, beginning image upload
Apr 11 23:06:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:44 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Snapshot image upload complete
Apr 11 23:06:44 user nova-compute[71516]: INFO nova.compute.manager [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Took 4.79 seconds to snapshot the instance on the hypervisor.
Apr 11 23:06:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-changed-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Refreshing instance network info cache due to event network-changed-b44a27e4-9811-4e81-8f41-c7f58def46bc. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:06:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] Acquiring lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:06:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] Acquired lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:06:44 user nova-compute[71516]: DEBUG nova.network.neutron [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Refreshing network info cache for port b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:06:44 user nova-compute[71516]: DEBUG nova.network.neutron [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updated VIF entry in instance network info cache for port b44a27e4-9811-4e81-8f41-c7f58def46bc. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:06:44 user nova-compute[71516]: DEBUG nova.network.neutron [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updating instance_info_cache with network_info: [{"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:06:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] Releasing lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:06:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "8322b884-2831-48af-a67e-26c31c17f49f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:46 user nova-compute[71516]: INFO nova.compute.manager [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Shelving
Apr 11 23:06:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:47 user nova-compute[71516]: DEBUG nova.compute.manager [req-b8c6635d-4007-4749-a23d-b874e3143658 req-cece322c-d281-45a1-a202-d8474cda4ab4 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-vif-unplugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b8c6635d-4007-4749-a23d-b874e3143658 req-cece322c-d281-45a1-a202-d8474cda4ab4 service nova] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b8c6635d-4007-4749-a23d-b874e3143658 req-cece322c-d281-45a1-a202-d8474cda4ab4 service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b8c6635d-4007-4749-a23d-b874e3143658 req-cece322c-d281-45a1-a202-d8474cda4ab4 service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:47 user nova-compute[71516]: DEBUG nova.compute.manager [req-b8c6635d-4007-4749-a23d-b874e3143658 req-cece322c-d281-45a1-a202-d8474cda4ab4 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] No waiting events found dispatching network-vif-unplugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:47 user nova-compute[71516]: WARNING nova.compute.manager [req-b8c6635d-4007-4749-a23d-b874e3143658 req-cece322c-d281-45a1-a202-d8474cda4ab4 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received unexpected event network-vif-unplugged-b44a27e4-9811-4e81-8f41-c7f58def46bc for instance with vm_state active and task_state shelving.
Apr 11 23:06:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:47 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Instance destroyed successfully.
Apr 11 23:06:47 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Beginning cold snapshot process
Apr 11 23:06:47 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:06:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk /opt/stack/data/nova/instances/snapshots/tmpa93_xgbm/21253925ca514364800d89714ec16bc1 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk /opt/stack/data/nova/instances/snapshots/tmpa93_xgbm/21253925ca514364800d89714ec16bc1" returned: 0 in 0.308s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:47 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Snapshot extracted, beginning image upload
Apr 11 23:06:49 user nova-compute[71516]: DEBUG nova.compute.manager [req-8689424a-f1d5-4223-a90b-a4a3b495ddc4 req-8ef7e0ab-9654-40fa-9367-996081c9c9da service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8689424a-f1d5-4223-a90b-a4a3b495ddc4 req-8ef7e0ab-9654-40fa-9367-996081c9c9da service nova] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8689424a-f1d5-4223-a90b-a4a3b495ddc4 req-8ef7e0ab-9654-40fa-9367-996081c9c9da service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8689424a-f1d5-4223-a90b-a4a3b495ddc4 req-8ef7e0ab-9654-40fa-9367-996081c9c9da service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:49 user nova-compute[71516]: DEBUG nova.compute.manager [req-8689424a-f1d5-4223-a90b-a4a3b495ddc4 req-8ef7e0ab-9654-40fa-9367-996081c9c9da service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] No waiting events found dispatching network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:06:49 user nova-compute[71516]: WARNING nova.compute.manager [req-8689424a-f1d5-4223-a90b-a4a3b495ddc4 req-8ef7e0ab-9654-40fa-9367-996081c9c9da service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received unexpected event network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 23:06:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:50 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Snapshot image upload complete
Apr 11 23:06:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:06:50 user nova-compute[71516]: INFO nova.compute.manager [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Shelve offloading
Apr 11 23:06:50 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Instance destroyed successfully.
Apr 11 23:06:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:06:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:06:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquired lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:06:50 user nova-compute[71516]: DEBUG nova.network.neutron [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:06:50 user nova-compute[71516]: DEBUG nova.network.neutron [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updating instance_info_cache with network_info: [{"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:06:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Releasing lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:06:51 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Instance destroyed successfully.
Apr 11 23:06:51 user nova-compute[71516]: DEBUG nova.objects.instance [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'resources' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-742046125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-742046125',id=4,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhq2c1AASfEGyAAJl+QIGDBVlGaQd5aU2DpuWVUMd+VgtFnNGA30jaPJqm7CxuxKNS3cfyVDWuM5n3h/I+Opv2IF/BYKVBsSYfscd1VrAJJc1HvdHk6jRHnOOCv9avuqQ==',key_name='tempest-keypair-208393987',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b466a7e141a247319eae64ab30aca760',ramdisk_id='',reservation_id='r-kxb0ie0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849897654',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849897654-project-member',shelved_at='2023-04-11T23:06:50.309455',shelved_host='user',shelved_image_id='1e2d8073-da39-4d01-8111-69c226b39850'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7272af33be864737b2231127f4323638',uuid=8322b884-2831-48af-a67e-26c31c17f49f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converting VIF {"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG os_vif [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb44a27e4-98, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-changed-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Refreshing instance network info cache due to event network-changed-b44a27e4-9811-4e81-8f41-c7f58def46bc. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] Acquiring lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] Acquired lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG nova.network.neutron [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Refreshing network info cache for port b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:51 user nova-compute[71516]: INFO os_vif [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98')
Apr 11 23:06:51 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Deleting instance files /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f_del
Apr 11 23:06:51 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Deletion of /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f_del complete
Apr 11 23:06:51 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Deleted allocations for instance 8322b884-2831-48af-a67e-26c31c17f49f
Apr 11 23:06:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:51 user nova-compute[71516]: DEBUG nova.objects.instance [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'numa_topology' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:06:52 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:06:52 user nova-compute[71516]: DEBUG nova.network.neutron [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updated VIF entry in instance network info cache for port b44a27e4-9811-4e81-8f41-c7f58def46bc. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:06:52 user nova-compute[71516]: DEBUG nova.network.neutron [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updating instance_info_cache with network_info: [{"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb44a27e4-98", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:06:52 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:06:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] Releasing lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:06:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "8322b884-2831-48af-a67e-26c31c17f49f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.477s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Received event network-changed-ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Refreshing instance network info cache due to event network-changed-ac411bad-0310-4c20-946a-b95b7b3e3e16. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:06:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] Acquiring lock "refresh_cache-fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:06:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] Acquired lock "refresh_cache-fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:06:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Refreshing network info cache for port ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:06:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Updated VIF entry in instance network info cache for port ac411bad-0310-4c20-946a-b95b7b3e3e16. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:06:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Updating instance_info_cache with network_info: [{"id": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "address": "fa:16:3e:e1:c0:a4", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac411bad-03", "ovs_interfaceid": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:06:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] Releasing lock "refresh_cache-fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:06:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:54 user nova-compute[71516]: DEBUG nova.objects.instance [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lazy-loading 'flavor' on Instance uuid fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:06:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:55 user nova-compute[71516]: INFO nova.compute.manager [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Attaching volume 93c2ce12-dbfc-4d27-8ef0-5021973204b3 to /dev/vdb
Apr 11 23:06:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG os_brick.utils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1b9c69-c647-447b-bf68-d462b18aa905]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c74eaf-0ef0-4378-be02-2baff21d414b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[54da9ce6-2aab-4910-baf4-58e21d29894f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dad18cd-8149-4e68-a56d-40116a6e6d0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:06:55 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e72afb-da87-4bfd-a3fe-482948a3020c]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG os_brick.utils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Updating existing volume attachment record: 237ec4d5-951a-4a29-9222-06cfab8bcfca {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Received event network-changed-37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Refreshing instance network info cache due to event network-changed-37163c3c-1128-4143-af68-134f3f922fa2. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] Acquiring lock "refresh_cache-5d6517f0-c4f0-4b35-a94a-610058ecc687" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] Acquired lock "refresh_cache-5d6517f0-c4f0-4b35-a94a-610058ecc687" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG nova.network.neutron [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Refreshing network info cache for port 37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:55 user nova-compute[71516]: DEBUG nova.objects.instance [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lazy-loading 'flavor' on Instance uuid 5d6517f0-c4f0-4b35-a94a-610058ecc687 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:06:56 user nova-compute[71516]: INFO nova.compute.manager [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Attaching volume 5041ddaf-d487-479c-a3e7-a06d7bdae1a6 to /dev/vdb
Apr 11 23:06:56 user nova-compute[71516]: DEBUG nova.network.neutron [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Updated VIF entry in instance network info cache for port 37163c3c-1128-4143-af68-134f3f922fa2. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG nova.network.neutron [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Updating instance_info_cache with network_info: [{"id": "37163c3c-1128-4143-af68-134f3f922fa2", "address": "fa:16:3e:1f:82:23", "network": {"id": "0c84d5db-4dde-46d7-8e55-dccce02872ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-146382199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "204fa09429ce4f2fafbc532805a346bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37163c3c-11", "ovs_interfaceid": "37163c3c-1128-4143-af68-134f3f922fa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG os_brick.utils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] Releasing lock "refresh_cache-5d6517f0-c4f0-4b35-a94a-610058ecc687" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b16998-7725-42cb-bb3c-dd884ff453e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5b408a-f529-4bb5-9450-77857ce1adc9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf063797-5fe3-4963-bce3-7e639a537e6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[914518c6-a193-4e08-af0d-213203276c50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:06:56 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:06:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6f1168-54dd-4cdc-8b58-f6c09111f5a6]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG os_brick.utils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Updating existing volume attachment record: 9aaeb1d9-11b0-4232-9dd2-0fa38b44d47f {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:06:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCRGENDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:06:59 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:06:59 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:06:59 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03e9112-0eb8-404d-8ab6-9a816da4c4c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:06:59 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[021abee9-d04f-48d3-bac4-641b578353a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3] added
Apr 11 23:06:59 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbf72b6-4421-4d8d-b736-190972b731f9]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5d1c41-7b59-46d9-9af6-cd7a5291ce28]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCRGENDJ {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCRGENDJ" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6085f1c6-6957-484e-923e-d23a4bf50397]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OCRGENDJ'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ebc50e-b8c0-4cf9-8e19-cbd76e8e0464]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d710b637-1793-47a0-b332-529b6bcf7b51]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:06:59 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:06:59 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2ef25e-781b-4395-8050-0b2fb89fe926]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3, portal: 172.16.0.220,3260]
Apr 11 23:06:59 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3, portal: 172.16.0.220,3260] successful.
Apr 11 23:06:59 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[63633acb-9f5f-4542-ab73-11b1a4f26d4f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ae74fa-0a6f-4230-aef6-091a11090d62]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:06:59 user nova-compute[71516]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 (non-flash)
Apr 11 23:06:59 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:06:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:00 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9ae86f-c388-436c-8857-4a940bcebed0]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:00 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: None {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:07:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:07:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLZoeWMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:00 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Received event network-changed-a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Refreshing instance network info cache due to event network-changed-a115300b-147f-450e-a3f8-94d5f0b70a06. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:07:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] Acquiring lock "refresh_cache-041d3e65-4e73-4416-8f0a-b2ff6dca3e77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:07:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] Acquired lock "refresh_cache-041d3e65-4e73-4416-8f0a-b2ff6dca3e77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:07:00 user nova-compute[71516]: DEBUG nova.network.neutron [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Refreshing network info cache for port a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCRGENDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23331376262326534', 'path': '/dev/sdi'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331376262326534', 'path': '/dev/sdi'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.428s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:01 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:01 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG nova.objects.instance [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lazy-loading 'flavor' on Instance uuid fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3977a31-0eb5-4be7-ab08-2f2cc6506067]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:07:01 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b91416-52be-40b9-99fb-5d8425770b55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6] added
Apr 11 23:07:01 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:07:01 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:07:01 user nova-compute[71516]:   <source dev="/dev/sdi"/>
Apr 11 23:07:01 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:07:01 user nova-compute[71516]:   <serial>93c2ce12-dbfc-4d27-8ef0-5021973204b3</serial>
Apr 11 23:07:01 user nova-compute[71516]: </disk>
Apr 11 23:07:01 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df0911e-8e46-4944-9945-2a6fdc57b010]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0afc65-1a68-4a7a-9ec1-ab2962e8b254]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLZoeWMa {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLZoeWMa" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad4784e-d4a4-4c14-8861-f885a9053f3d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mLZoeWMa'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[55306141-1df2-4ac5-884a-47bc900981c2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8cdb7b-c13c-413c-b222-cdb1b50d2ffd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG nova.network.neutron [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Updated VIF entry in instance network info cache for port a115300b-147f-450e-a3f8-94d5f0b70a06. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG nova.network.neutron [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Updating instance_info_cache with network_info: [{"id": "a115300b-147f-450e-a3f8-94d5f0b70a06", "address": "fa:16:3e:dc:14:66", "network": {"id": "89fffa37-15ee-4d3d-84ff-6a77c47b321d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1750297065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a01d410ba24128b6a884f317687a7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa115300b-14", "ovs_interfaceid": "a115300b-147f-450e-a3f8-94d5f0b70a06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] Releasing lock "refresh_cache-041d3e65-4e73-4416-8f0a-b2ff6dca3e77" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[eced7bb3-877b-4152-af7e-87c89e037e94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260]
Apr 11 23:07:01 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:01 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[784b0498-9c3d-45d7-9918-36bc791c5cca]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea007745-3f51-405b-a0aa-7d2a7e69c3f6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:01 user nova-compute[71516]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 (non-flash)
Apr 11 23:07:01 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3581a200-6b14-4979-9e24-b6c5747c279b]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLZoeWMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] No VIF found with MAC fa:16:3e:e1:c0:a4, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.565s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG nova.objects.instance [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lazy-loading 'flavor' on Instance uuid 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] <== connect_volume: return (1830ms) {'type': 'block', 'scsi_wwn': '23363303530336261', 'path': '/dev/sdj'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363303530336261', 'path': '/dev/sdj'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG nova.objects.instance [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lazy-loading 'flavor' on Instance uuid 5d6517f0-c4f0-4b35-a94a-610058ecc687 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254407.433269, 8322b884-2831-48af-a67e-26c31c17f49f => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:07:02 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] VM Stopped (Lifecycle Event)
Apr 11 23:07:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-f36ce856-62ad-45bf-af5f-d950e74aef44 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:07:02 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:07:02 user nova-compute[71516]:   <source dev="/dev/sdj"/>
Apr 11 23:07:02 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:07:02 user nova-compute[71516]:   <serial>5041ddaf-d487-479c-a3e7-a06d7bdae1a6</serial>
Apr 11 23:07:02 user nova-compute[71516]: </disk>
Apr 11 23:07:02 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:02 user nova-compute[71516]: INFO nova.compute.manager [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Attaching volume f73aa597-317a-4488-8c76-1d2d243f9f6a to /dev/sdc
Apr 11 23:07:02 user nova-compute[71516]: DEBUG os_brick.utils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ead1d85-626d-441e-8817-2b6d2eb0b05f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c523851-93c4-4e28-8d16-d00391b3be3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98fe6ed-fd78-4a17-a162-90b38541cc3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[24476526-3e69-4aba-a254-171e4755f99c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:07:02 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:07:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a761f9f1-14cc-4d4a-b660-fc98d30e1b3c]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG os_brick.utils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Updating existing volume attachment record: 542fd9d1-0aa4-4ae4-b91b-e585da68f66f {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:07:02 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] No VIF found with MAC fa:16:3e:1f:82:23, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.832s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-changed-ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Refreshing instance network info cache due to event network-changed-ce46605b-463c-483c-9887-8923c6b74bbd. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] Acquiring lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] Acquired lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG nova.network.neutron [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Refreshing network info cache for port ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:03 user nova-compute[71516]: INFO nova.compute.manager [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Detaching volume 93c2ce12-dbfc-4d27-8ef0-5021973204b3
Apr 11 23:07:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "interface-902899b9-8c8f-404e-a110-832b3c91d526-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "interface-902899b9-8c8f-404e-a110-832b3c91d526-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.004s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG nova.objects.instance [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lazy-loading 'flavor' on Instance uuid 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:03 user nova-compute[71516]: INFO nova.virt.block_device [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Attempting to driver detach volume 93c2ce12-dbfc-4d27-8ef0-5021973204b3 from mountpoint /dev/vdb
Apr 11 23:07:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Attempting to detach device vdb from instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:07:03 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:07:03 user nova-compute[71516]:   <source dev="/dev/sdi"/>
Apr 11 23:07:03 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:07:03 user nova-compute[71516]:   <serial>93c2ce12-dbfc-4d27-8ef0-5021973204b3</serial>
Apr 11 23:07:03 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:07:03 user nova-compute[71516]: </disk>
Apr 11 23:07:03 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:07:03 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Successfully detached device vdb from instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 from the persistent domain config.
Apr 11 23:07:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:07:03 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:07:03 user nova-compute[71516]:   <source dev="/dev/sdi"/>
Apr 11 23:07:03 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:07:03 user nova-compute[71516]:   <serial>93c2ce12-dbfc-4d27-8ef0-5021973204b3</serial>
Apr 11 23:07:03 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:07:03 user nova-compute[71516]: </disk>
Apr 11 23:07:03 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG nova.objects.instance [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lazy-loading 'pci_requests' on Instance uuid 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681254423.986281, fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:07:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:07:03 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Successfully detached device vdb from instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 from the live domain config.
Apr 11 23:07:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCRGENDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:04 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b483de2e-a5da-4090-9155-b15a81cbeb75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:07:04 user nova-compute[71516]: No targets found.
Apr 11 23:07:04 user nova-compute[71516]: iSNS:
Apr 11 23:07:04 user nova-compute[71516]: No targets found.
Apr 11 23:07:04 user nova-compute[71516]: STATIC:
Apr 11 23:07:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a
Apr 11 23:07:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405
Apr 11 23:07:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd
Apr 11 23:07:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc
Apr 11 23:07:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57
Apr 11 23:07:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6
Apr 11 23:07:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3
Apr 11 23:07:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3
Apr 11 23:07:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9
Apr 11 23:07:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:04 user nova-compute[71516]: FIRMWARE:
Apr 11 23:07:04 user nova-compute[71516]: No targets found.
Apr 11 23:07:04 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:07:04 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:07:04 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b1a0b7-a8fe-4938-862c-d09b0d2fa1f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f207498-5f13-49af-9a5e-6ca97f7c1508]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 (non-flash)
Apr 11 23:07:04 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:04 user nova-compute[71516]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 (non-flash)
Apr 11 23:07:04 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c6d9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3'): ({'sdi'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Removing single pathed devices sdi {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaf113e-49cc-4274-abfb-e661dd37f562]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[275cddce-1389-43e2-905c-a6b93e090f09]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Flushing IO for device /dev/sdi {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e941f3f-0c2d-40b2-b361-a4da080fbe60]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.037s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef66311d-f87f-4dfc-b98e-41203b65909a]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] SCSI volumes sdi have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG nova.network.neutron [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Updated VIF entry in instance network info cache for port ce46605b-463c-483c-9887-8923c6b74bbd. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG nova.network.neutron [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Updating instance_info_cache with network_info: [{"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd00c3b-66f3-4cee-8a1d-e0727ba5fb3f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] Releasing lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG nova.policy [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Acquiring lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.utils [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa3fed1-b79b-4dc1-9950-f7d30df56e69]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3, portal: 172.16.0.220,3260]
Apr 11 23:07:04 user nova-compute[71516]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:04 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee933dab-813a-4950-98bc-f20dfc0063d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[22da806a-d6a4-4e55-b92f-00c82f3a9b92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c2ce12-dbfc-4d27-8ef0-5021973204b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5f7b7b-8f35-4b97-a004-4858b104856e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] <== disconnect_volume: return (368ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca96823-b019-4512-ae88-2b17d5aa07d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[47edd3fa-c3df-403b-859d-0cf2d25f88b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:07:04 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:07:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fc9888-ad0b-465c-b970-37a3203be427]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:07:04 user nova-compute[71516]: DEBUG os_brick.utils [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:04 user nova-compute[71516]: INFO nova.compute.manager [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Swapping volume 5041ddaf-d487-479c-a3e7-a06d7bdae1a6 for be9133e2-d785-4ec4-b4a1-843e8def60ba
Apr 11 23:07:04 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Successfully created port: 85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:07:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:05 user nova-compute[71516]: DEBUG nova.objects.instance [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lazy-loading 'flavor' on Instance uuid fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.756s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:05 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Successfully updated port: 85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:07:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:07:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquired lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:07:05 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:07:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-changed-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Refreshing instance network info cache due to event network-changed-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:07:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] Acquiring lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.network.neutron [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Updating instance_info_cache with network_info: [{"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Releasing lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] Acquired lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.network.neutron [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Refreshing network info cache for port 85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1742434033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1742434033',id=8,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjYyFfjZ4jJzoYCxHNitzizXcyb+46lxif+p1WR3AxkPOuuDeeRO58EcoDOCV1AotgbxMzrZn7KKNU1EvmEh6aGyzyrtnw/YgTuT0xmESOl+oFG8zQeViLhG0BqUIwvWg==',key_name='tempest-keypair-1602402085',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='35fb372296e5430e9f915be720934494',ramdisk_id='',reservation_id='r-4b344c26',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2113709125',owner_user_name='tempest-TaggedAttachmentsTest-2113709125-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343064f07762476ca5221be36dcbd0de',uuid=902899b9-8c8f-404e-a110-832b3c91d526,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converting VIF {"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e6:76,bridge_name='br-int',has_traffic_filtering=True,id=85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230,network=Network(878270a4-e4b7-4b97-8a78-2db5a6493445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d9a5fe-ae') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG os_vif [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e6:76,bridge_name='br-int',has_traffic_filtering=True,id=85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230,network=Network(878270a4-e4b7-4b97-8a78-2db5a6493445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d9a5fe-ae') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85d9a5fe-ae, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85d9a5fe-ae, col_values=(('external_ids', {'iface-id': '85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:e6:76', 'vm-uuid': '902899b9-8c8f-404e-a110-832b3c91d526'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:06 user nova-compute[71516]: INFO os_vif [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e6:76,bridge_name='br-int',has_traffic_filtering=True,id=85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230,network=Network(878270a4-e4b7-4b97-8a78-2db5a6493445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d9a5fe-ae')
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1742434033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1742434033',id=8,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjYyFfjZ4jJzoYCxHNitzizXcyb+46lxif+p1WR3AxkPOuuDeeRO58EcoDOCV1AotgbxMzrZn7KKNU1EvmEh6aGyzyrtnw/YgTuT0xmESOl+oFG8zQeViLhG0BqUIwvWg==',key_name='tempest-keypair-1602402085',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='35fb372296e5430e9f915be720934494',ramdisk_id='',reservation_id='r-4b344c26',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2113709125',owner_user_name='tempest-TaggedAttachmentsTest-2113709125-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343064f07762476ca5221be36dcbd0de',uuid=902899b9-8c8f-404e-a110-832b3c91d526,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converting VIF {"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e6:76,bridge_name='br-int',has_traffic_filtering=True,id=85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230,network=Network(878270a4-e4b7-4b97-8a78-2db5a6493445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d9a5fe-ae') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] attach device xml: <interface type="ethernet">
Apr 11 23:07:06 user nova-compute[71516]:   <mac address="fa:16:3e:7c:e6:76"/>
Apr 11 23:07:06 user nova-compute[71516]:   <model type="virtio"/>
Apr 11 23:07:06 user nova-compute[71516]:   <mtu size="1442"/>
Apr 11 23:07:06 user nova-compute[71516]:   <target dev="tap85d9a5fe-ae"/>
Apr 11 23:07:06 user nova-compute[71516]: </interface>
Apr 11 23:07:06 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] No BDM found with device name hda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] No VIF found with MAC fa:16:3e:da:ae:a2, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.network.neutron [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Updated VIF entry in instance network info cache for port 85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.network.neutron [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Updating instance_info_cache with network_info: [{"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:07:06 user nova-compute[71516]:   <nova:package version="0.0.0"/>
Apr 11 23:07:06 user nova-compute[71516]:   <nova:name>tempest-device-tagging-server-1742434033</nova:name>
Apr 11 23:07:06 user nova-compute[71516]:   <nova:creationTime>2023-04-11 23:07:06</nova:creationTime>
Apr 11 23:07:06 user nova-compute[71516]:   <nova:flavor name="m1.nano">
Apr 11 23:07:06 user nova-compute[71516]:     <nova:memory>128</nova:memory>
Apr 11 23:07:06 user nova-compute[71516]:     <nova:disk>1</nova:disk>
Apr 11 23:07:06 user nova-compute[71516]:     <nova:swap>0</nova:swap>
Apr 11 23:07:06 user nova-compute[71516]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:07:06 user nova-compute[71516]:     <nova:vcpus>1</nova:vcpus>
Apr 11 23:07:06 user nova-compute[71516]:   </nova:flavor>
Apr 11 23:07:06 user nova-compute[71516]:   <nova:owner>
Apr 11 23:07:06 user nova-compute[71516]:     <nova:user uuid="343064f07762476ca5221be36dcbd0de">tempest-TaggedAttachmentsTest-2113709125-project-member</nova:user>
Apr 11 23:07:06 user nova-compute[71516]:     <nova:project uuid="35fb372296e5430e9f915be720934494">tempest-TaggedAttachmentsTest-2113709125</nova:project>
Apr 11 23:07:06 user nova-compute[71516]:   </nova:owner>
Apr 11 23:07:06 user nova-compute[71516]:   <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:07:06 user nova-compute[71516]:   <nova:ports>
Apr 11 23:07:06 user nova-compute[71516]:     <nova:port uuid="ce46605b-463c-483c-9887-8923c6b74bbd">
Apr 11 23:07:06 user nova-compute[71516]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 23:07:06 user nova-compute[71516]:     </nova:port>
Apr 11 23:07:06 user nova-compute[71516]:     <nova:port uuid="85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230">
Apr 11 23:07:06 user nova-compute[71516]:       <nova:ip type="fixed" address="10.10.10.88" ipVersion="4"/>
Apr 11 23:07:06 user nova-compute[71516]:     </nova:port>
Apr 11 23:07:06 user nova-compute[71516]:   </nova:ports>
Apr 11 23:07:06 user nova-compute[71516]: </nova:instance>
Apr 11 23:07:06 user nova-compute[71516]:  {{(pid=71516) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.compute.manager [req-bbab73ea-9240-44a7-9643-eb7fdfaed8e1 req-f5bcbce5-a1af-4b2d-94cc-0d89cef8b392 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-vif-plugged-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bbab73ea-9240-44a7-9643-eb7fdfaed8e1 req-f5bcbce5-a1af-4b2d-94cc-0d89cef8b392 service nova] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bbab73ea-9240-44a7-9643-eb7fdfaed8e1 req-f5bcbce5-a1af-4b2d-94cc-0d89cef8b392 service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bbab73ea-9240-44a7-9643-eb7fdfaed8e1 req-f5bcbce5-a1af-4b2d-94cc-0d89cef8b392 service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG nova.compute.manager [req-bbab73ea-9240-44a7-9643-eb7fdfaed8e1 req-f5bcbce5-a1af-4b2d-94cc-0d89cef8b392 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] No waiting events found dispatching network-vif-plugged-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:06 user nova-compute[71516]: WARNING nova.compute.manager [req-bbab73ea-9240-44a7-9643-eb7fdfaed8e1 req-f5bcbce5-a1af-4b2d-94cc-0d89cef8b392 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received unexpected event network-vif-plugged-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 for instance with vm_state active and task_state None.
Apr 11 23:07:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] Releasing lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "interface-902899b9-8c8f-404e-a110-832b3c91d526-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.222s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtXGbAdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:07 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:07 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:07 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bff6d4c-06a6-4b9e-a131-6521ec60a5d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:07:07 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "902899b9-8c8f-404e-a110-832b3c91d526" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffafd6a-6870-43df-9b2b-83191ee1e207]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a] added
Apr 11 23:07:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG nova.objects.instance [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lazy-loading 'flavor' on Instance uuid 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[946c99fa-c7c8-4ac7-b6bf-64b1c5b47d08]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "902899b9-8c8f-404e-a110-832b3c91d526" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db7149f-cbe0-4f5c-bf11-843a180729b7]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YtXGbAdk {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YtXGbAdk" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ab7811-01bf-49b4-8944-2e2f77af8988]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YtXGbAdk'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb1388c-d1aa-47af-bb2c-fd54fb063a4c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c89a68-8398-49ca-8cc8-791462dbea0d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "902899b9-8c8f-404e-a110-832b3c91d526" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:07 user nova-compute[71516]: INFO nova.compute.manager [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Attaching volume f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 to /dev/vdb
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4fd427-dbf4-42cd-a737-6cf61cd4b688]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a, portal: 172.16.0.220,3260]
Apr 11 23:07:07 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c17058-9857-4713-9653-8226d92df29b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.utils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b7c520-384d-4139-8c7e-c53fa0707ff0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:07 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5601c8b-7273-45be-818d-c0b5e4e530e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ff8b0c-9fb6-446e-9c93-e06d74078eb0]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtXGbAdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e77ff7-e37b-48ad-9146-b02286bef40b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c862cb-7dac-4bd1-b345-e2ed11da8324]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d866572d-368d-4298-9447-716f6fcf0ca7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:07:07 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:07:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfafd3b-27af-44fe-801d-751386b49acf]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG os_brick.utils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:07 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Updating existing volume attachment record: 5c322a71-e214-4b8f-8a1b-dc9eea4baa01 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:07:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23661643832353065', 'path': '/dev/sdi'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661643832353065', 'path': '/dev/sdi'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:07:08 user nova-compute[71516]: DEBUG nova.objects.instance [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lazy-loading 'flavor' on Instance uuid 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:07:08 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:07:08 user nova-compute[71516]:   <source dev="/dev/sdi"/>
Apr 11 23:07:08 user nova-compute[71516]:   <target dev="sdc" bus="scsi"/>
Apr 11 23:07:08 user nova-compute[71516]:   <serial>f73aa597-317a-4488-8c76-1d2d243f9f6a</serial>
Apr 11 23:07:08 user nova-compute[71516]:   <address type="drive" controller="0" unit="2"/>
Apr 11 23:07:08 user nova-compute[71516]: </disk>
Apr 11 23:07:08 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:07:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-b2ca0dfb-a07e-4858-95c1-77e39fcfe7f8 req-90f701c1-ae2a-4c4b-8fe2-11e370f67d98 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-vif-plugged-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b2ca0dfb-a07e-4858-95c1-77e39fcfe7f8 req-90f701c1-ae2a-4c4b-8fe2-11e370f67d98 service nova] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b2ca0dfb-a07e-4858-95c1-77e39fcfe7f8 req-90f701c1-ae2a-4c4b-8fe2-11e370f67d98 service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b2ca0dfb-a07e-4858-95c1-77e39fcfe7f8 req-90f701c1-ae2a-4c4b-8fe2-11e370f67d98 service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-b2ca0dfb-a07e-4858-95c1-77e39fcfe7f8 req-90f701c1-ae2a-4c4b-8fe2-11e370f67d98 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] No waiting events found dispatching network-vif-plugged-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:08 user nova-compute[71516]: WARNING nova.compute.manager [req-b2ca0dfb-a07e-4858-95c1-77e39fcfe7f8 req-90f701c1-ae2a-4c4b-8fe2-11e370f67d98 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received unexpected event network-vif-plugged-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 for instance with vm_state active and task_state None.
Apr 11 23:07:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] No BDM found with device name sda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:07:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:07:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:07:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] No VIF found with MAC fa:16:3e:dc:14:66, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.635s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGYTRovw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5d6517f0-c4f0-4b35-a94a-610058ecc687', 'attached_at': '', 'detached_at': '', 'volume_id': 'be9133e2-d785-4ec4-b4a1-843e8def60ba', 'serial': 'be9133e2-d785-4ec4-b4a1-843e8def60ba'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLZoeWMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '5d6517f0-c4f0-4b35-a94a-610058ecc687', 'attached_at': '', 'detached_at': '', 'volume_id': '5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 'serial'} {{(pid=71516) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGYTRovw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:09 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:09 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:09 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dd2ea3-87b9-4896-a555-d919cac4b7aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:07:09 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8373557e-b58b-4b93-bc8a-29545997bdf7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba] added
Apr 11 23:07:09 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a6e8f5-c67a-4338-9a12-0cec20336fba]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73ee75e-4084-41fc-a68b-10b9947586e8]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SGYTRovw {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SGYTRovw" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fade4bf-1639-45a6-a122-9368e620b2dd]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SGYTRovw'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eaafc98-e097-4f8c-9c63-b47bf29d860d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b60a6d2-1cc4-4f73-b0ba-618bdf7e6f3f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:09 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:09 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bafa148-6e1f-4785-be43-5f7e23d34110]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba, portal: 172.16.0.220,3260]
Apr 11 23:07:09 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:09 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4d4076-cd5a-4e7b-a58f-1d83fe825514]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c832e6b-e97c-4d84-aa4a-fb8882e41619]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:09 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:09 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:09 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0096257-f1b8-4916-85c0-e5a3184a87f9]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:07:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGYTRovw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:10 user nova-compute[71516]: INFO nova.compute.manager [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Detaching volume f73aa597-317a-4488-8c76-1d2d243f9f6a
Apr 11 23:07:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:10 user nova-compute[71516]: INFO nova.virt.block_device [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Attempting to driver detach volume f73aa597-317a-4488-8c76-1d2d243f9f6a from mountpoint /dev/sdc
Apr 11 23:07:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Attempting to detach device sdc from instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:07:10 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:07:10 user nova-compute[71516]:   <source dev="/dev/sdi"/>
Apr 11 23:07:10 user nova-compute[71516]:   <target dev="sdc" bus="scsi"/>
Apr 11 23:07:10 user nova-compute[71516]:   <serial>f73aa597-317a-4488-8c76-1d2d243f9f6a</serial>
Apr 11 23:07:10 user nova-compute[71516]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 23:07:10 user nova-compute[71516]: </disk>
Apr 11 23:07:10 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:07:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Successfully detached device sdc from instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 from the persistent domain config.
Apr 11 23:07:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:07:10 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:07:10 user nova-compute[71516]:   <source dev="/dev/sdi"/>
Apr 11 23:07:10 user nova-compute[71516]:   <target dev="sdc" bus="scsi"/>
Apr 11 23:07:10 user nova-compute[71516]:   <serial>f73aa597-317a-4488-8c76-1d2d243f9f6a</serial>
Apr 11 23:07:10 user nova-compute[71516]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 23:07:10 user nova-compute[71516]: </disk>
Apr 11 23:07:10 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681254430.5497122, 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:07:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Successfully detached device sdc from instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 from the live domain config.
Apr 11 23:07:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtXGbAdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:10 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23835373237636634', 'path': '/dev/sdk'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835373237636634', 'path': '/dev/sdk'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.381s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG nova.objects.instance [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lazy-loading 'flavor' on Instance uuid 5d6517f0-c4f0-4b35-a94a-610058ecc687 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2498bc5e-bc73-47c9-9b70-b9a4a02205dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:07:10 user nova-compute[71516]: No targets found.
Apr 11 23:07:10 user nova-compute[71516]: iSNS:
Apr 11 23:07:10 user nova-compute[71516]: No targets found.
Apr 11 23:07:10 user nova-compute[71516]: STATIC:
Apr 11 23:07:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a
Apr 11 23:07:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a
Apr 11 23:07:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba
Apr 11 23:07:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405
Apr 11 23:07:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd
Apr 11 23:07:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc
Apr 11 23:07:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57
Apr 11 23:07:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6
Apr 11 23:07:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3
Apr 11 23:07:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9
Apr 11 23:07:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:10 user nova-compute[71516]: FIRMWARE:
Apr 11 23:07:10 user nova-compute[71516]: No targets found.
Apr 11 23:07:10 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:07:10 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:07:10 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a2cdd6-5c75-4163-9c39-051b53575066]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5c6306-c61b-4ed0-af10-6004ccf33a99]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:11 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:11 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:11 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5fd48550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a'): ({'sdi'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Removing single pathed devices sdi {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc653f9b-6867-49f4-aa27-c910d78a548e]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c342bb94-3c51-4cd4-af2f-d9530dbfa706]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Flushing IO for device /dev/sdi {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c20bb77-4132-4598-9113-08d4dfc7eda9]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9066f82-f12e-4dd1-b0b9-93c9e8d8482a]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] SCSI volumes sdi have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce2e0fe-9a35-4a69-8032-2a2f01d9e42c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9abe9ec-7e91-469a-a983-0fde971e983d]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a, portal: 172.16.0.220,3260]
Apr 11 23:07:11 user nova-compute[71516]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:11 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f73aa597-317a-4488-8c76-1d2d243f9f6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[47718b47-dfa2-47b1-87b2-0ff2f76a2df0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] <== disconnect_volume: return (742ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 126877696 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxcMTDQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:12 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:12 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:12 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1495d9-4ef9-4388-b64c-e99eaa9c60b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:07:12 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7018805e-0482-4896-95c0-eae52d88cc8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945] added
Apr 11 23:07:12 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.075s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfc6cc5-ef61-472f-8dae-8c00445d2705]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba482306-ab90-444b-9453-8b194f2c4c58]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KxcMTDQv {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KxcMTDQv" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4322f3fd-6fe5-4018-82d9-99f54f940eb3]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KxcMTDQv'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9626a9a-511b-497c-a0a9-bef6610d4103]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[739a4b73-f235-4c2e-a433-8cb8241ee6c8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:12 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:12 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:12 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 265289728 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG nova.objects.instance [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lazy-loading 'flavor' on Instance uuid 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.645s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 425721856 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 596639744 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --login" returned: 0 in 1.148s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebe66ff-5b84-48cb-add7-58e0af089025]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945, portal: 172.16.0.220,3260]
Apr 11 23:07:13 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:13 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d7ccd7-7ef3-4afd-a44e-d93275c94fb9]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fc99eb-086a-4499-bed8-c2511ecdbd55]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:13 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:13 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:13 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.537s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d2dc81-6236-4290-a17d-6801227ac7f5]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: None {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:07:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 748683264 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:14 user nova-compute[71516]: INFO nova.compute.manager [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Terminating instance
Apr 11 23:07:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG nova.compute.manager [req-ce77c0e8-5409-418c-afda-08f313d2d548 req-5aea4dfd-6725-4f59-a181-a658b0480bf8 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Received event network-vif-unplugged-a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ce77c0e8-5409-418c-afda-08f313d2d548 req-5aea4dfd-6725-4f59-a181-a658b0480bf8 service nova] Acquiring lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ce77c0e8-5409-418c-afda-08f313d2d548 req-5aea4dfd-6725-4f59-a181-a658b0480bf8 service nova] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ce77c0e8-5409-418c-afda-08f313d2d548 req-5aea4dfd-6725-4f59-a181-a658b0480bf8 service nova] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG nova.compute.manager [req-ce77c0e8-5409-418c-afda-08f313d2d548 req-5aea4dfd-6725-4f59-a181-a658b0480bf8 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] No waiting events found dispatching network-vif-unplugged-a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG nova.compute.manager [req-ce77c0e8-5409-418c-afda-08f313d2d548 req-5aea4dfd-6725-4f59-a181-a658b0480bf8 service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Received event network-vif-unplugged-a115300b-147f-450e-a3f8-94d5f0b70a06 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 904921088 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxcMTDQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.576s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] <== connect_volume: return (2578ms) {'type': 'block', 'scsi_wwn': '23836646433616235', 'path': '/dev/sdi'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836646433616235', 'path': '/dev/sdi'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG nova.objects.instance [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lazy-loading 'flavor' on Instance uuid 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:07:14 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:07:14 user nova-compute[71516]:   <source dev="/dev/sdi"/>
Apr 11 23:07:14 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:07:14 user nova-compute[71516]:   <serial>f2a6741f-6d85-4c26-8ff2-0dfefb4c6945</serial>
Apr 11 23:07:14 user nova-compute[71516]: </disk>
Apr 11 23:07:14 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:07:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 1066401792 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:15 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Instance destroyed successfully.
Apr 11 23:07:15 user nova-compute[71516]: DEBUG nova.objects.instance [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lazy-loading 'resources' on Instance uuid 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1001345895',display_name='tempest-AttachSCSIVolumeTestJSON-server-1001345895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1001345895',id=7,image_ref='593cabf7-840e-46c9-8f3d-2f5b1d39023f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrUyvv9xJhmprh9AK+up58UndvSccnxFuoMXv0YaoKFD6ViJ/cCVH/dZhQWHCTvniN/nJcx+Yxib3iT4OoYKuJjAnAkIXNDljHm3326qgsWCqfKYBDSjK9hSyBSEHpiew==',key_name='tempest-keypair-1505121934',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13a01d410ba24128b6a884f317687a7d',ramdisk_id='',reservation_id='r-200yws17',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='593cabf7-840e-46c9-8f3d-2f5b1d39023f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2004545832',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2004545832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:05:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe4793e0b50343c3b0795159dbcbf46b',uuid=041d3e65-4e73-4416-8f0a-b2ff6dca3e77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a115300b-147f-450e-a3f8-94d5f0b70a06", "address": "fa:16:3e:dc:14:66", "network": {"id": "89fffa37-15ee-4d3d-84ff-6a77c47b321d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1750297065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a01d410ba24128b6a884f317687a7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa115300b-14", "ovs_interfaceid": "a115300b-147f-450e-a3f8-94d5f0b70a06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Converting VIF {"id": "a115300b-147f-450e-a3f8-94d5f0b70a06", "address": "fa:16:3e:dc:14:66", "network": {"id": "89fffa37-15ee-4d3d-84ff-6a77c47b321d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1750297065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13a01d410ba24128b6a884f317687a7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa115300b-14", "ovs_interfaceid": "a115300b-147f-450e-a3f8-94d5f0b70a06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:14:66,bridge_name='br-int',has_traffic_filtering=True,id=a115300b-147f-450e-a3f8-94d5f0b70a06,network=Network(89fffa37-15ee-4d3d-84ff-6a77c47b321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa115300b-14') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_vif [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:14:66,bridge_name='br-int',has_traffic_filtering=True,id=a115300b-147f-450e-a3f8-94d5f0b70a06,network=Network(89fffa37-15ee-4d3d-84ff-6a77c47b321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa115300b-14') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa115300b-14, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:15 user nova-compute[71516]: INFO os_vif [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:14:66,bridge_name='br-int',has_traffic_filtering=True,id=a115300b-147f-450e-a3f8-94d5f0b70a06,network=Network(89fffa37-15ee-4d3d-84ff-6a77c47b321d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa115300b-14')
Apr 11 23:07:15 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Deleting instance files /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77_del
Apr 11 23:07:15 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Deletion of /opt/stack/data/nova/instances/041d3e65-4e73-4416-8f0a-b2ff6dca3e77_del complete
Apr 11 23:07:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] No BDM found with device name hda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] No VIF found with MAC fa:16:3e:da:ae:a2, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:07:15 user nova-compute[71516]: INFO nova.compute.manager [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "902899b9-8c8f-404e-a110-832b3c91d526" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.139s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLZoeWMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:15 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[706a9a2d-270d-43c2-892e-7d4bd5016a2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:07:15 user nova-compute[71516]: No targets found.
Apr 11 23:07:15 user nova-compute[71516]: iSNS:
Apr 11 23:07:15 user nova-compute[71516]: No targets found.
Apr 11 23:07:15 user nova-compute[71516]: STATIC:
Apr 11 23:07:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945
Apr 11 23:07:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a
Apr 11 23:07:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba
Apr 11 23:07:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405
Apr 11 23:07:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd
Apr 11 23:07:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc
Apr 11 23:07:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57
Apr 11 23:07:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6
Apr 11 23:07:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3
Apr 11 23:07:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9
Apr 11 23:07:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:15 user nova-compute[71516]: FIRMWARE:
Apr 11 23:07:15 user nova-compute[71516]: No targets found.
Apr 11 23:07:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:07:15 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:07:15 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ad050f-f55b-4a17-8e1f-3af9087ca632]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c642cc-b243-4102-a9ad-cd3cf1b569f5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:15 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5419e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6'): ({'sdj'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Removing single pathed devices sdj {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61495c9-66bc-45b7-abac-4a4e7be55979]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac2c83f-905f-4e07-9fd7-4ddf911d7abb]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Flushing IO for device /dev/sdj {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[510d1762-9a82-4b59-9004-41b479efc028]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.039s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca3b735-c262-4671-8582-83cccd7392f7]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] SCSI volumes sdj have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba237412-2637-4d20-b61a-1c47c7a2dad2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddbd293-4fd7-4621-8646-88b7b75b4fd6]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260]
Apr 11 23:07:15 user nova-compute[71516]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b557761d-fcc9-47f7-b151-bb2d65d90dd7]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] <== disconnect_volume: return (361ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG nova.compute.manager [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGYTRovw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '5d6517f0-c4f0-4b35-a94a-610058ecc687', 'attached_at': '', 'detached_at': '', 'volume_id': 'be9133e2-d785-4ec4-b4a1-843e8def60ba', 'serial'} {{(pid=71516) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG nova.compute.manager [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] swap_volume: removing Cinder connection for volume 5041ddaf-d487-479c-a3e7-a06d7bdae1a6 {{(pid=71516) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:16 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Took 0.87 seconds to deallocate network for instance.
Apr 11 23:07:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Received event network-vif-plugged-a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] Acquiring lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] No waiting events found dispatching network-vif-plugged-a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:16 user nova-compute[71516]: WARNING nova.compute.manager [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Received unexpected event network-vif-plugged-a115300b-147f-450e-a3f8-94d5f0b70a06 for instance with vm_state deleted and task_state None.
Apr 11 23:07:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Received event network-vif-deleted-a115300b-147f-450e-a3f8-94d5f0b70a06 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "902899b9-8c8f-404e-a110-832b3c91d526" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:16 user nova-compute[71516]: INFO nova.compute.manager [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Detaching volume f2a6741f-6d85-4c26-8ff2-0dfefb4c6945
Apr 11 23:07:16 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Deleted allocations for instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77
Apr 11 23:07:16 user nova-compute[71516]: INFO nova.virt.block_device [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Attempting to driver detach volume f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 from mountpoint /dev/vdb
Apr 11 23:07:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Attempting to detach device vdb from instance 902899b9-8c8f-404e-a110-832b3c91d526 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:07:16 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:07:16 user nova-compute[71516]:   <source dev="/dev/sdi"/>
Apr 11 23:07:16 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:07:16 user nova-compute[71516]:   <serial>f2a6741f-6d85-4c26-8ff2-0dfefb4c6945</serial>
Apr 11 23:07:16 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 23:07:16 user nova-compute[71516]: </disk>
Apr 11 23:07:16 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:07:16 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Successfully detached device vdb from instance 902899b9-8c8f-404e-a110-832b3c91d526 from the persistent domain config.
Apr 11 23:07:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 902899b9-8c8f-404e-a110-832b3c91d526 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:07:16 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:07:16 user nova-compute[71516]:   <source dev="/dev/sdi"/>
Apr 11 23:07:16 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:07:16 user nova-compute[71516]:   <serial>f2a6741f-6d85-4c26-8ff2-0dfefb4c6945</serial>
Apr 11 23:07:16 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 23:07:16 user nova-compute[71516]: </disk>
Apr 11 23:07:16 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "041d3e65-4e73-4416-8f0a-b2ff6dca3e77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.732s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:16 user nova-compute[71516]: DEBUG nova.compute.manager [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] swap_volume: Updating volume 5041ddaf-d487-479c-a3e7-a06d7bdae1a6 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "SGYTRovw", "auth_password": "9Oecys5jnUQZVJ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "be9133e2-d785-4ec4-b4a1-843e8def60ba"}, "status": "reserved", "instance": "5d6517f0-c4f0-4b35-a94a-610058ecc687", "attached_at": "", "detached_at": "", "volume_id": "be9133e2-d785-4ec4-b4a1-843e8def60ba", "serial": "be9133e2-d785-4ec4-b4a1-843e8def60ba"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'be9133e2-d785-4ec4-b4a1-843e8def60ba', 'no_device': None, 'attachment_id': 'c086c9e6-ac7e-41e4-881b-a1d373d42639'} {{(pid=71516) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.741s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681254437.1523035, 902899b9-8c8f-404e-a110-832b3c91d526 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:07:17 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Successfully detached device vdb from instance 902899b9-8c8f-404e-a110-832b3c91d526 from the live domain config.
Apr 11 23:07:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxcMTDQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:17 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dd5484-9678-4ccc-98b3-134173e5973e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:07:17 user nova-compute[71516]: No targets found.
Apr 11 23:07:17 user nova-compute[71516]: iSNS:
Apr 11 23:07:17 user nova-compute[71516]: No targets found.
Apr 11 23:07:17 user nova-compute[71516]: STATIC:
Apr 11 23:07:17 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945
Apr 11 23:07:17 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:17 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:17 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a
Apr 11 23:07:17 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:17 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:17 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba
Apr 11 23:07:17 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:17 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:17 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405
Apr 11 23:07:17 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:17 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:17 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd
Apr 11 23:07:17 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:17 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:17 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc
Apr 11 23:07:17 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:17 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:17 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57
Apr 11 23:07:17 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:17 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:17 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3
Apr 11 23:07:17 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:17 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:17 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9
Apr 11 23:07:17 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:17 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:17 user nova-compute[71516]: FIRMWARE:
Apr 11 23:07:17 user nova-compute[71516]: No targets found.
Apr 11 23:07:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:07:17 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:07:17 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46b7819-fda6-44bb-b9f3-39b214f7fd87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57b0bfe-a3e8-4089-8da9-9984e82a4968]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:17 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5fe72200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945'): ({'sdi'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Removing single pathed devices sdi {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ee7249-abcb-426c-84c2-61ee5134062d]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d921fe-d4cf-44fa-8bf8-a244bdf61ebf]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Flushing IO for device /dev/sdi {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4d5d1e-88d1-4273-8f00-ffaf42249c45]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b9527a-a7dd-4b74-8ab1-f2e5949b7a58]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] SCSI volumes sdi have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e1bc99-8391-449f-b630-fbe16c0c4125]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c813da5-a69b-4ee3-897e-d7df331db1f4]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945, portal: 172.16.0.220,3260]
Apr 11 23:07:17 user nova-compute[71516]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c6cc21-dae7-4459-adfd-be525ad08615]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] <== disconnect_volume: return (370ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Acquiring lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.utils [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3856041-79b7-490e-9616-6d428533805c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbbabbb-f54b-41bb-857b-92d6a20e69c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb08099-80e4-41e3-b03b-6587c7b540df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d03115-6f64-4f8b-b498-82e7353d83ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:07:17 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:07:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1148f6-e6d1-4625-b760-122a229d724e]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:07:17 user nova-compute[71516]: DEBUG os_brick.utils [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:18 user nova-compute[71516]: INFO nova.compute.manager [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Swapping volume be9133e2-d785-4ec4-b4a1-843e8def60ba for 5041ddaf-d487-479c-a3e7-a06d7bdae1a6
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.objects.instance [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lazy-loading 'flavor' on Instance uuid 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "902899b9-8c8f-404e-a110-832b3c91d526" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.828s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "f79fcca6-9f11-498f-b580-5681f9589a77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "f79fcca6-9f11-498f-b580-5681f9589a77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:18 user nova-compute[71516]: INFO nova.compute.manager [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Terminating instance
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.compute.manager [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-50905e37-d553-4423-9225-78f6e39dbbb4 req-732e278f-e43e-4495-be39-ef2e91f68424 service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Received event network-vif-unplugged-1c726827-fb42-4618-ac03-9051705301a0 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-50905e37-d553-4423-9225-78f6e39dbbb4 req-732e278f-e43e-4495-be39-ef2e91f68424 service nova] Acquiring lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-50905e37-d553-4423-9225-78f6e39dbbb4 req-732e278f-e43e-4495-be39-ef2e91f68424 service nova] Lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-50905e37-d553-4423-9225-78f6e39dbbb4 req-732e278f-e43e-4495-be39-ef2e91f68424 service nova] Lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-50905e37-d553-4423-9225-78f6e39dbbb4 req-732e278f-e43e-4495-be39-ef2e91f68424 service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] No waiting events found dispatching network-vif-unplugged-1c726827-fb42-4618-ac03-9051705301a0 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-50905e37-d553-4423-9225-78f6e39dbbb4 req-732e278f-e43e-4495-be39-ef2e91f68424 service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Received event network-vif-unplugged-1c726827-fb42-4618-ac03-9051705301a0 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "interface-902899b9-8c8f-404e-a110-832b3c91d526-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "interface-902899b9-8c8f-404e-a110-832b3c91d526-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lazy-loading 'flavor' on Instance uuid 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1742434033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1742434033',id=8,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjYyFfjZ4jJzoYCxHNitzizXcyb+46lxif+p1WR3AxkPOuuDeeRO58EcoDOCV1AotgbxMzrZn7KKNU1EvmEh6aGyzyrtnw/YgTuT0xmESOl+oFG8zQeViLhG0BqUIwvWg==',key_name='tempest-keypair-1602402085',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35fb372296e5430e9f915be720934494',ramdisk_id='',reservation_id='r-4b344c26',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2113709125',owner_user_name='tempest-TaggedAttachmentsTest-2113709125-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343064f07762476ca5221be36dcbd0de',uuid=902899b9-8c8f-404e-a110-832b3c91d526,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converting VIF {"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e6:76,bridge_name='br-int',has_traffic_filtering=True,id=85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230,network=Network(878270a4-e4b7-4b97-8a78-2db5a6493445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d9a5fe-ae') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7c:e6:76"/><model type="virtio"/><mtu size="1442"/><target dev="tap85d9a5fe-ae"/></interface> {{(pid=71516) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7c:e6:76"/><model type="virtio"/><mtu size="1442"/><target dev="tap85d9a5fe-ae"/></interface> {{(pid=71516) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Attempting to detach device tap85d9a5fe-ae from instance 902899b9-8c8f-404e-a110-832b3c91d526 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] detach device xml: <interface type="ethernet">
Apr 11 23:07:18 user nova-compute[71516]:   <mac address="fa:16:3e:7c:e6:76"/>
Apr 11 23:07:18 user nova-compute[71516]:   <model type="virtio"/>
Apr 11 23:07:18 user nova-compute[71516]:   <mtu size="1442"/>
Apr 11 23:07:18 user nova-compute[71516]:   <target dev="tap85d9a5fe-ae"/>
Apr 11 23:07:18 user nova-compute[71516]: </interface>
Apr 11 23:07:18 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7c:e6:76"/><model type="virtio"/><mtu size="1442"/><target dev="tap85d9a5fe-ae"/></interface> {{(pid=71516) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 23:07:18 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7c:e6:76"/><model type="virtio"/><mtu size="1442"/><target dev="tap85d9a5fe-ae"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 11 23:07:18 user nova-compute[71516]:   <name>instance-00000008</name>
Apr 11 23:07:18 user nova-compute[71516]:   <uuid>902899b9-8c8f-404e-a110-832b3c91d526</uuid>
Apr 11 23:07:18 user nova-compute[71516]:   <metadata>
Apr 11 23:07:18 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:07:18 user nova-compute[71516]:   <nova:package version="0.0.0"/>
Apr 11 23:07:18 user nova-compute[71516]:   <nova:name>tempest-device-tagging-server-1742434033</nova:name>
Apr 11 23:07:18 user nova-compute[71516]:   <nova:creationTime>2023-04-11 23:07:06</nova:creationTime>
Apr 11 23:07:18 user nova-compute[71516]:   <nova:flavor name="m1.nano">
Apr 11 23:07:18 user nova-compute[71516]:     <nova:memory>128</nova:memory>
Apr 11 23:07:18 user nova-compute[71516]:     <nova:disk>1</nova:disk>
Apr 11 23:07:18 user nova-compute[71516]:     <nova:swap>0</nova:swap>
Apr 11 23:07:18 user nova-compute[71516]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:07:18 user nova-compute[71516]:     <nova:vcpus>1</nova:vcpus>
Apr 11 23:07:18 user nova-compute[71516]:   </nova:flavor>
Apr 11 23:07:18 user nova-compute[71516]:   <nova:owner>
Apr 11 23:07:18 user nova-compute[71516]:     <nova:user uuid="343064f07762476ca5221be36dcbd0de">tempest-TaggedAttachmentsTest-2113709125-project-member</nova:user>
Apr 11 23:07:18 user nova-compute[71516]:     <nova:project uuid="35fb372296e5430e9f915be720934494">tempest-TaggedAttachmentsTest-2113709125</nova:project>
Apr 11 23:07:18 user nova-compute[71516]:   </nova:owner>
Apr 11 23:07:18 user nova-compute[71516]:   <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:07:18 user nova-compute[71516]:   <nova:ports>
Apr 11 23:07:18 user nova-compute[71516]:     <nova:port uuid="ce46605b-463c-483c-9887-8923c6b74bbd">
Apr 11 23:07:18 user nova-compute[71516]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 23:07:18 user nova-compute[71516]:     </nova:port>
Apr 11 23:07:18 user nova-compute[71516]:     <nova:port uuid="85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230">
Apr 11 23:07:18 user nova-compute[71516]:       <nova:ip type="fixed" address="10.10.10.88" ipVersion="4"/>
Apr 11 23:07:18 user nova-compute[71516]:     </nova:port>
Apr 11 23:07:18 user nova-compute[71516]:   </nova:ports>
Apr 11 23:07:18 user nova-compute[71516]: </nova:instance>
Apr 11 23:07:18 user nova-compute[71516]:   </metadata>
Apr 11 23:07:18 user nova-compute[71516]:   <memory unit='KiB'>131072</memory>
Apr 11 23:07:18 user nova-compute[71516]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 23:07:18 user nova-compute[71516]:   <vcpu placement='static'>1</vcpu>
Apr 11 23:07:18 user nova-compute[71516]:   <resource>
Apr 11 23:07:18 user nova-compute[71516]:     <partition>/machine</partition>
Apr 11 23:07:18 user nova-compute[71516]:   </resource>
Apr 11 23:07:18 user nova-compute[71516]:   <sysinfo type='smbios'>
Apr 11 23:07:18 user nova-compute[71516]:     <system>
Apr 11 23:07:18 user nova-compute[71516]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 23:07:18 user nova-compute[71516]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 23:07:18 user nova-compute[71516]:       <entry name='version'>0.0.0</entry>
Apr 11 23:07:18 user nova-compute[71516]:       <entry name='serial'>902899b9-8c8f-404e-a110-832b3c91d526</entry>
Apr 11 23:07:18 user nova-compute[71516]:       <entry name='uuid'>902899b9-8c8f-404e-a110-832b3c91d526</entry>
Apr 11 23:07:18 user nova-compute[71516]:       <entry name='family'>Virtual Machine</entry>
Apr 11 23:07:18 user nova-compute[71516]:     </system>
Apr 11 23:07:18 user nova-compute[71516]:   </sysinfo>
Apr 11 23:07:18 user nova-compute[71516]:   <os>
Apr 11 23:07:18 user nova-compute[71516]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 23:07:18 user nova-compute[71516]:     <boot dev='hd'/>
Apr 11 23:07:18 user nova-compute[71516]:     <smbios mode='sysinfo'/>
Apr 11 23:07:18 user nova-compute[71516]:   </os>
Apr 11 23:07:18 user nova-compute[71516]:   <features>
Apr 11 23:07:18 user nova-compute[71516]:     <acpi/>
Apr 11 23:07:18 user nova-compute[71516]:     <apic/>
Apr 11 23:07:18 user nova-compute[71516]:     <vmcoreinfo state='on'/>
Apr 11 23:07:18 user nova-compute[71516]:   </features>
Apr 11 23:07:18 user nova-compute[71516]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 23:07:18 user nova-compute[71516]:     <model fallback='forbid'>Nehalem</model>
Apr 11 23:07:18 user nova-compute[71516]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 23:07:18 user nova-compute[71516]:     <feature policy='require' name='vme'/>
Apr 11 23:07:18 user nova-compute[71516]:     <feature policy='require' name='x2apic'/>
Apr 11 23:07:18 user nova-compute[71516]:     <feature policy='require' name='hypervisor'/>
Apr 11 23:07:18 user nova-compute[71516]:   </cpu>
Apr 11 23:07:18 user nova-compute[71516]:   <clock offset='utc'>
Apr 11 23:07:18 user nova-compute[71516]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 23:07:18 user nova-compute[71516]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 23:07:18 user nova-compute[71516]:     <timer name='hpet' present='no'/>
Apr 11 23:07:18 user nova-compute[71516]:   </clock>
Apr 11 23:07:18 user nova-compute[71516]:   <on_poweroff>destroy</on_poweroff>
Apr 11 23:07:18 user nova-compute[71516]:   <on_reboot>restart</on_reboot>
Apr 11 23:07:18 user nova-compute[71516]:   <on_crash>destroy</on_crash>
Apr 11 23:07:18 user nova-compute[71516]:   <devices>
Apr 11 23:07:18 user nova-compute[71516]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 23:07:18 user nova-compute[71516]:     <disk type='file' device='disk'>
Apr 11 23:07:18 user nova-compute[71516]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 23:07:18 user nova-compute[71516]:       <source file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk' index='2'/>
Apr 11 23:07:18 user nova-compute[71516]:       <backingStore type='file' index='3'>
Apr 11 23:07:18 user nova-compute[71516]:         <format type='raw'/>
Apr 11 23:07:18 user nova-compute[71516]:         <source file='/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4'/>
Apr 11 23:07:18 user nova-compute[71516]:         <backingStore/>
Apr 11 23:07:18 user nova-compute[71516]:       </backingStore>
Apr 11 23:07:18 user nova-compute[71516]:       <target dev='vda' bus='virtio'/>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='virtio-disk0'/>
Apr 11 23:07:18 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 23:07:18 user nova-compute[71516]:     </disk>
Apr 11 23:07:18 user nova-compute[71516]:     <disk type='file' device='cdrom'>
Apr 11 23:07:18 user nova-compute[71516]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 23:07:18 user nova-compute[71516]:       <source file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk.config' index='1'/>
Apr 11 23:07:18 user nova-compute[71516]:       <backingStore/>
Apr 11 23:07:18 user nova-compute[71516]:       <target dev='hda' bus='ide'/>
Apr 11 23:07:18 user nova-compute[71516]:       <readonly/>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='ide0-0-0'/>
Apr 11 23:07:18 user nova-compute[71516]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 23:07:18 user nova-compute[71516]:     </disk>
Apr 11 23:07:18 user nova-compute[71516]:     <controller type='usb' index='0' model='none'>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='usb'/>
Apr 11 23:07:18 user nova-compute[71516]:     </controller>
Apr 11 23:07:18 user nova-compute[71516]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='pci.0'/>
Apr 11 23:07:18 user nova-compute[71516]:     </controller>
Apr 11 23:07:18 user nova-compute[71516]:     <controller type='ide' index='0'>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='ide'/>
Apr 11 23:07:18 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 23:07:18 user nova-compute[71516]:     </controller>
Apr 11 23:07:18 user nova-compute[71516]:     <interface type='ethernet'>
Apr 11 23:07:18 user nova-compute[71516]:       <mac address='fa:16:3e:da:ae:a2'/>
Apr 11 23:07:18 user nova-compute[71516]:       <target dev='tapce46605b-46'/>
Apr 11 23:07:18 user nova-compute[71516]:       <model type='virtio'/>
Apr 11 23:07:18 user nova-compute[71516]:       <mtu size='1442'/>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='net0'/>
Apr 11 23:07:18 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 23:07:18 user nova-compute[71516]:     </interface>
Apr 11 23:07:18 user nova-compute[71516]:     <interface type='ethernet'>
Apr 11 23:07:18 user nova-compute[71516]:       <mac address='fa:16:3e:7c:e6:76'/>
Apr 11 23:07:18 user nova-compute[71516]:       <target dev='tap85d9a5fe-ae'/>
Apr 11 23:07:18 user nova-compute[71516]:       <model type='virtio'/>
Apr 11 23:07:18 user nova-compute[71516]:       <mtu size='1442'/>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='net1'/>
Apr 11 23:07:18 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 11 23:07:18 user nova-compute[71516]:     </interface>
Apr 11 23:07:18 user nova-compute[71516]:     <serial type='pty'>
Apr 11 23:07:18 user nova-compute[71516]:       <source path='/dev/pts/7'/>
Apr 11 23:07:18 user nova-compute[71516]:       <log file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/console.log' append='off'/>
Apr 11 23:07:18 user nova-compute[71516]:       <target type='isa-serial' port='0'>
Apr 11 23:07:18 user nova-compute[71516]:         <model name='isa-serial'/>
Apr 11 23:07:18 user nova-compute[71516]:       </target>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='serial0'/>
Apr 11 23:07:18 user nova-compute[71516]:     </serial>
Apr 11 23:07:18 user nova-compute[71516]:     <console type='pty' tty='/dev/pts/7'>
Apr 11 23:07:18 user nova-compute[71516]:       <source path='/dev/pts/7'/>
Apr 11 23:07:18 user nova-compute[71516]:       <log file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/console.log' append='off'/>
Apr 11 23:07:18 user nova-compute[71516]:       <target type='serial' port='0'/>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='serial0'/>
Apr 11 23:07:18 user nova-compute[71516]:     </console>
Apr 11 23:07:18 user nova-compute[71516]:     <input type='mouse' bus='ps2'>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='input0'/>
Apr 11 23:07:18 user nova-compute[71516]:     </input>
Apr 11 23:07:18 user nova-compute[71516]:     <input type='keyboard' bus='ps2'>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='input1'/>
Apr 11 23:07:18 user nova-compute[71516]:     </input>
Apr 11 23:07:18 user nova-compute[71516]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 11 23:07:18 user nova-compute[71516]:       <listen type='address' address='0.0.0.0'/>
Apr 11 23:07:18 user nova-compute[71516]:     </graphics>
Apr 11 23:07:18 user nova-compute[71516]:     <audio id='1' type='none'/>
Apr 11 23:07:18 user nova-compute[71516]:     <video>
Apr 11 23:07:18 user nova-compute[71516]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='video0'/>
Apr 11 23:07:18 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 23:07:18 user nova-compute[71516]:     </video>
Apr 11 23:07:18 user nova-compute[71516]:     <memballoon model='virtio'>
Apr 11 23:07:18 user nova-compute[71516]:       <stats period='10'/>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='balloon0'/>
Apr 11 23:07:18 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 23:07:18 user nova-compute[71516]:     </memballoon>
Apr 11 23:07:18 user nova-compute[71516]:     <rng model='virtio'>
Apr 11 23:07:18 user nova-compute[71516]:       <backend model='random'>/dev/urandom</backend>
Apr 11 23:07:18 user nova-compute[71516]:       <alias name='rng0'/>
Apr 11 23:07:18 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 23:07:18 user nova-compute[71516]:     </rng>
Apr 11 23:07:18 user nova-compute[71516]:   </devices>
Apr 11 23:07:18 user nova-compute[71516]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 23:07:18 user nova-compute[71516]:     <label>libvirt-902899b9-8c8f-404e-a110-832b3c91d526</label>
Apr 11 23:07:18 user nova-compute[71516]:     <imagelabel>libvirt-902899b9-8c8f-404e-a110-832b3c91d526</imagelabel>
Apr 11 23:07:18 user nova-compute[71516]:   </seclabel>
Apr 11 23:07:18 user nova-compute[71516]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 23:07:18 user nova-compute[71516]:     <label>+64055:+108</label>
Apr 11 23:07:18 user nova-compute[71516]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 23:07:18 user nova-compute[71516]:   </seclabel>
Apr 11 23:07:18 user nova-compute[71516]: </domain>
Apr 11 23:07:18 user nova-compute[71516]:  {{(pid=71516) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 23:07:19 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Successfully detached device tap85d9a5fe-ae from instance 902899b9-8c8f-404e-a110-832b3c91d526 from the persistent domain config.
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] (1/8): Attempting to detach device tap85d9a5fe-ae with device alias net1 from instance 902899b9-8c8f-404e-a110-832b3c91d526 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] detach device xml: <interface type="ethernet">
Apr 11 23:07:19 user nova-compute[71516]:   <mac address="fa:16:3e:7c:e6:76"/>
Apr 11 23:07:19 user nova-compute[71516]:   <model type="virtio"/>
Apr 11 23:07:19 user nova-compute[71516]:   <mtu size="1442"/>
Apr 11 23:07:19 user nova-compute[71516]:   <target dev="tap85d9a5fe-ae"/>
Apr 11 23:07:19 user nova-compute[71516]: </interface>
Apr 11 23:07:19 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:07:19 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Instance destroyed successfully.
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.objects.instance [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lazy-loading 'resources' on Instance uuid f79fcca6-9f11-498f-b580-5681f9589a77 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1905021876',display_name='tempest-TestVolumeBootPattern-server-1905021876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1905021876',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-kw85ohfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:05:46Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=f79fcca6-9f11-498f-b580-5681f9589a77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c726827-fb42-4618-ac03-9051705301a0", "address": "fa:16:3e:ec:91:49", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c726827-fb", "ovs_interfaceid": "1c726827-fb42-4618-ac03-9051705301a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "1c726827-fb42-4618-ac03-9051705301a0", "address": "fa:16:3e:ec:91:49", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c726827-fb", "ovs_interfaceid": "1c726827-fb42-4618-ac03-9051705301a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:91:49,bridge_name='br-int',has_traffic_filtering=True,id=1c726827-fb42-4618-ac03-9051705301a0,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c726827-fb') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_vif [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:91:49,bridge_name='br-int',has_traffic_filtering=True,id=1c726827-fb42-4618-ac03-9051705301a0,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c726827-fb') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681254439.2553985, 902899b9-8c8f-404e-a110-832b3c91d526 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Start waiting for the detach event from libvirt for device tap85d9a5fe-ae with device alias net1 for instance 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7c:e6:76"/><model type="virtio"/><mtu size="1442"/><target dev="tap85d9a5fe-ae"/></interface> {{(pid=71516) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c726827-fb, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7c:e6:76"/><model type="virtio"/><mtu size="1442"/><target dev="tap85d9a5fe-ae"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 11 23:07:19 user nova-compute[71516]:   <name>instance-00000008</name>
Apr 11 23:07:19 user nova-compute[71516]:   <uuid>902899b9-8c8f-404e-a110-832b3c91d526</uuid>
Apr 11 23:07:19 user nova-compute[71516]:   <metadata>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:07:19 user nova-compute[71516]:   <nova:package version="0.0.0"/>
Apr 11 23:07:19 user nova-compute[71516]:   <nova:name>tempest-device-tagging-server-1742434033</nova:name>
Apr 11 23:07:19 user nova-compute[71516]:   <nova:creationTime>2023-04-11 23:07:06</nova:creationTime>
Apr 11 23:07:19 user nova-compute[71516]:   <nova:flavor name="m1.nano">
Apr 11 23:07:19 user nova-compute[71516]:     <nova:memory>128</nova:memory>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:disk>1</nova:disk>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:swap>0</nova:swap>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:vcpus>1</nova:vcpus>
Apr 11 23:07:19 user nova-compute[71516]:   </nova:flavor>
Apr 11 23:07:19 user nova-compute[71516]:   <nova:owner>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:user uuid="343064f07762476ca5221be36dcbd0de">tempest-TaggedAttachmentsTest-2113709125-project-member</nova:user>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:project uuid="35fb372296e5430e9f915be720934494">tempest-TaggedAttachmentsTest-2113709125</nova:project>
Apr 11 23:07:19 user nova-compute[71516]:   </nova:owner>
Apr 11 23:07:19 user nova-compute[71516]:   <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:07:19 user nova-compute[71516]:   <nova:ports>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:port uuid="ce46605b-463c-483c-9887-8923c6b74bbd">
Apr 11 23:07:19 user nova-compute[71516]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 23:07:19 user nova-compute[71516]:     </nova:port>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:port uuid="85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230">
Apr 11 23:07:19 user nova-compute[71516]:       <nova:ip type="fixed" address="10.10.10.88" ipVersion="4"/>
Apr 11 23:07:19 user nova-compute[71516]:     </nova:port>
Apr 11 23:07:19 user nova-compute[71516]:   </nova:ports>
Apr 11 23:07:19 user nova-compute[71516]: </nova:instance>
Apr 11 23:07:19 user nova-compute[71516]:   </metadata>
Apr 11 23:07:19 user nova-compute[71516]:   <memory unit='KiB'>131072</memory>
Apr 11 23:07:19 user nova-compute[71516]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 23:07:19 user nova-compute[71516]:   <vcpu placement='static'>1</vcpu>
Apr 11 23:07:19 user nova-compute[71516]:   <resource>
Apr 11 23:07:19 user nova-compute[71516]:     <partition>/machine</partition>
Apr 11 23:07:19 user nova-compute[71516]:   </resource>
Apr 11 23:07:19 user nova-compute[71516]:   <sysinfo type='smbios'>
Apr 11 23:07:19 user nova-compute[71516]:     <system>
Apr 11 23:07:19 user nova-compute[71516]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 23:07:19 user nova-compute[71516]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 23:07:19 user nova-compute[71516]:       <entry name='version'>0.0.0</entry>
Apr 11 23:07:19 user nova-compute[71516]:       <entry name='serial'>902899b9-8c8f-404e-a110-832b3c91d526</entry>
Apr 11 23:07:19 user nova-compute[71516]:       <entry name='uuid'>902899b9-8c8f-404e-a110-832b3c91d526</entry>
Apr 11 23:07:19 user nova-compute[71516]:       <entry name='family'>Virtual Machine</entry>
Apr 11 23:07:19 user nova-compute[71516]:     </system>
Apr 11 23:07:19 user nova-compute[71516]:   </sysinfo>
Apr 11 23:07:19 user nova-compute[71516]:   <os>
Apr 11 23:07:19 user nova-compute[71516]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 23:07:19 user nova-compute[71516]:     <boot dev='hd'/>
Apr 11 23:07:19 user nova-compute[71516]:     <smbios mode='sysinfo'/>
Apr 11 23:07:19 user nova-compute[71516]:   </os>
Apr 11 23:07:19 user nova-compute[71516]:   <features>
Apr 11 23:07:19 user nova-compute[71516]:     <acpi/>
Apr 11 23:07:19 user nova-compute[71516]:     <apic/>
Apr 11 23:07:19 user nova-compute[71516]:     <vmcoreinfo state='on'/>
Apr 11 23:07:19 user nova-compute[71516]:   </features>
Apr 11 23:07:19 user nova-compute[71516]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 23:07:19 user nova-compute[71516]:     <model fallback='forbid'>Nehalem</model>
Apr 11 23:07:19 user nova-compute[71516]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 23:07:19 user nova-compute[71516]:     <feature policy='require' name='vme'/>
Apr 11 23:07:19 user nova-compute[71516]:     <feature policy='require' name='x2apic'/>
Apr 11 23:07:19 user nova-compute[71516]:     <feature policy='require' name='hypervisor'/>
Apr 11 23:07:19 user nova-compute[71516]:   </cpu>
Apr 11 23:07:19 user nova-compute[71516]:   <clock offset='utc'>
Apr 11 23:07:19 user nova-compute[71516]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 23:07:19 user nova-compute[71516]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 23:07:19 user nova-compute[71516]:     <timer name='hpet' present='no'/>
Apr 11 23:07:19 user nova-compute[71516]:   </clock>
Apr 11 23:07:19 user nova-compute[71516]:   <on_poweroff>destroy</on_poweroff>
Apr 11 23:07:19 user nova-compute[71516]:   <on_reboot>restart</on_reboot>
Apr 11 23:07:19 user nova-compute[71516]:   <on_crash>destroy</on_crash>
Apr 11 23:07:19 user nova-compute[71516]:   <devices>
Apr 11 23:07:19 user nova-compute[71516]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 23:07:19 user nova-compute[71516]:     <disk type='file' device='disk'>
Apr 11 23:07:19 user nova-compute[71516]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 23:07:19 user nova-compute[71516]:       <source file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk' index='2'/>
Apr 11 23:07:19 user nova-compute[71516]:       <backingStore type='file' index='3'>
Apr 11 23:07:19 user nova-compute[71516]:         <format type='raw'/>
Apr 11 23:07:19 user nova-compute[71516]:         <source file='/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4'/>
Apr 11 23:07:19 user nova-compute[71516]:         <backingStore/>
Apr 11 23:07:19 user nova-compute[71516]:       </backingStore>
Apr 11 23:07:19 user nova-compute[71516]:       <target dev='vda' bus='virtio'/>
Apr 11 23:07:19 user nova-compute[71516]:       <alias name='virtio-disk0'/>
Apr 11 23:07:19 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 23:07:19 user nova-compute[71516]:     </disk>
Apr 11 23:07:19 user nova-compute[71516]:     <disk type='file' device='cdrom'>
Apr 11 23:07:19 user nova-compute[71516]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 23:07:19 user nova-compute[71516]:       <source file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk.config' index='1'/>
Apr 11 23:07:19 user nova-compute[71516]:       <backingStore/>
Apr 11 23:07:19 user nova-compute[71516]:       <target dev='hda' bus='ide'/>
Apr 11 23:07:19 user nova-compute[71516]:       <readonly/>
Apr 11 23:07:19 user nova-compute[71516]:       <alias name='ide0-0-0'/>
Apr 11 23:07:19 user nova-compute[71516]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 23:07:19 user nova-compute[71516]:     </disk>
Apr 11 23:07:19 user nova-compute[71516]:     <controller type='usb' index='0' model='none'>
Apr 11 23:07:19 user nova-compute[71516]:       <alias name='usb'/>
Apr 11 23:07:19 user nova-compute[71516]:     </controller>
Apr 11 23:07:19 user nova-compute[71516]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 23:07:19 user nova-compute[71516]:       <alias name='pci.0'/>
Apr 11 23:07:19 user nova-compute[71516]:     </controller>
Apr 11 23:07:19 user nova-compute[71516]:     <controller type='ide' index='0'>
Apr 11 23:07:19 user nova-compute[71516]:       <alias name='ide'/>
Apr 11 23:07:19 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 23:07:19 user nova-compute[71516]:     </controller>
Apr 11 23:07:19 user nova-compute[71516]:     <interface type='ethernet'>
Apr 11 23:07:19 user nova-compute[71516]:       <mac address='fa:16:3e:da:ae:a2'/>
Apr 11 23:07:19 user nova-compute[71516]:       <target dev='tapce46605b-46'/>
Apr 11 23:07:19 user nova-compute[71516]:       <model type='virtio'/>
Apr 11 23:07:19 user nova-compute[71516]:       <mtu size='1442'/>
Apr 11 23:07:19 user nova-compute[71516]:       <alias name='net0'/>
Apr 11 23:07:19 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 23:07:19 user nova-compute[71516]:     </interface>
Apr 11 23:07:19 user nova-compute[71516]:     <serial type='pty'>
Apr 11 23:07:19 user nova-compute[71516]:       <source path='/dev/pts/7'/>
Apr 11 23:07:19 user nova-compute[71516]:       <log file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/console.log' append='off'/>
Apr 11 23:07:19 user nova-compute[71516]:       <target type='isa-serial' port='0'>
Apr 11 23:07:19 user nova-compute[71516]:         <model name='isa-serial'/>
Apr 11 23:07:19 user nova-compute[71516]:       </target>
Apr 11 23:07:19 user nova-compute[71516]:       <alias name='serial0'/>
Apr 11 23:07:19 user nova-compute[71516]:     </serial>
Apr 11 23:07:19 user nova-compute[71516]:     <console type='pty' tty='/dev/pts/7'>
Apr 11 23:07:19 user nova-compute[71516]:       <source path='/dev/pts/7'/>
Apr 11 23:07:19 user nova-compute[71516]:       <log file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/console.log' append='off'/>
Apr 11 23:07:19 user nova-compute[71516]:       <target type='serial' port='0'/>
Apr 11 23:07:19 user nova-compute[71516]:       <alias name='serial0'/>
Apr 11 23:07:19 user nova-compute[71516]:     </console>
Apr 11 23:07:19 user nova-compute[71516]:     <input type='mouse' bus='ps2'>
Apr 11 23:07:19 user nova-compute[71516]:       <alias name='input0'/>
Apr 11 23:07:19 user nova-compute[71516]:     </input>
Apr 11 23:07:19 user nova-compute[71516]:     <input type='keyboard' bus='ps2'>
Apr 11 23:07:19 user nova-compute[71516]:       <alias name='input1'/>
Apr 11 23:07:19 user nova-compute[71516]:     </input>
Apr 11 23:07:19 user nova-compute[71516]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 11 23:07:19 user nova-compute[71516]:       <listen type='address' address='0.0.0.0'/>
Apr 11 23:07:19 user nova-compute[71516]:     </graphics>
Apr 11 23:07:19 user nova-compute[71516]:     <audio id='1' type='none'/>
Apr 11 23:07:19 user nova-compute[71516]:     <video>
Apr 11 23:07:19 user nova-compute[71516]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 23:07:19 user nova-compute[71516]:       <alias name='video0'/>
Apr 11 23:07:19 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 23:07:19 user nova-compute[71516]:     </video>
Apr 11 23:07:19 user nova-compute[71516]:     <memballoon model='virtio'>
Apr 11 23:07:19 user nova-compute[71516]:       <stats period='10'/>
Apr 11 23:07:19 user nova-compute[71516]:       <alias name='balloon0'/>
Apr 11 23:07:19 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 23:07:19 user nova-compute[71516]:     </memballoon>
Apr 11 23:07:19 user nova-compute[71516]:     <rng model='virtio'>
Apr 11 23:07:19 user nova-compute[71516]:       <backend model='random'>/dev/urandom</backend>
Apr 11 23:07:19 user nova-compute[71516]:       <alias name='rng0'/>
Apr 11 23:07:19 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 23:07:19 user nova-compute[71516]:     </rng>
Apr 11 23:07:19 user nova-compute[71516]:   </devices>
Apr 11 23:07:19 user nova-compute[71516]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 23:07:19 user nova-compute[71516]:     <label>libvirt-902899b9-8c8f-404e-a110-832b3c91d526</label>
Apr 11 23:07:19 user nova-compute[71516]:     <imagelabel>libvirt-902899b9-8c8f-404e-a110-832b3c91d526</imagelabel>
Apr 11 23:07:19 user nova-compute[71516]:   </seclabel>
Apr 11 23:07:19 user nova-compute[71516]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 23:07:19 user nova-compute[71516]:     <label>+64055:+108</label>
Apr 11 23:07:19 user nova-compute[71516]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 23:07:19 user nova-compute[71516]:   </seclabel>
Apr 11 23:07:19 user nova-compute[71516]: </domain>
Apr 11 23:07:19 user nova-compute[71516]:  {{(pid=71516) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 23:07:19 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Successfully detached device tap85d9a5fe-ae from instance 902899b9-8c8f-404e-a110-832b3c91d526 from the live domain config.
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1742434033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1742434033',id=8,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjYyFfjZ4jJzoYCxHNitzizXcyb+46lxif+p1WR3AxkPOuuDeeRO58EcoDOCV1AotgbxMzrZn7KKNU1EvmEh6aGyzyrtnw/YgTuT0xmESOl+oFG8zQeViLhG0BqUIwvWg==',key_name='tempest-keypair-1602402085',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35fb372296e5430e9f915be720934494',ramdisk_id='',reservation_id='r-4b344c26',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2113709125',owner_user_name='tempest-TaggedAttachmentsTest-2113709125-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343064f07762476ca5221be36dcbd0de',uuid=902899b9-8c8f-404e-a110-832b3c91d526,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converting VIF {"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e6:76,bridge_name='br-int',has_traffic_filtering=True,id=85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230,network=Network(878270a4-e4b7-4b97-8a78-2db5a6493445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d9a5fe-ae') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_vif [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e6:76,bridge_name='br-int',has_traffic_filtering=True,id=85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230,network=Network(878270a4-e4b7-4b97-8a78-2db5a6493445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d9a5fe-ae') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85d9a5fe-ae, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:19 user nova-compute[71516]: INFO os_vif [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:91:49,bridge_name='br-int',has_traffic_filtering=True,id=1c726827-fb42-4618-ac03-9051705301a0,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c726827-fb')
Apr 11 23:07:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZCHvVdT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:19 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:19 user nova-compute[71516]: INFO os_vif [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e6:76,bridge_name='br-int',has_traffic_filtering=True,id=85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230,network=Network(878270a4-e4b7-4b97-8a78-2db5a6493445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d9a5fe-ae')
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:07:19 user nova-compute[71516]:   <nova:package version="0.0.0"/>
Apr 11 23:07:19 user nova-compute[71516]:   <nova:name>tempest-device-tagging-server-1742434033</nova:name>
Apr 11 23:07:19 user nova-compute[71516]:   <nova:creationTime>2023-04-11 23:07:19</nova:creationTime>
Apr 11 23:07:19 user nova-compute[71516]:   <nova:flavor name="m1.nano">
Apr 11 23:07:19 user nova-compute[71516]:     <nova:memory>128</nova:memory>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:disk>1</nova:disk>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:swap>0</nova:swap>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:vcpus>1</nova:vcpus>
Apr 11 23:07:19 user nova-compute[71516]:   </nova:flavor>
Apr 11 23:07:19 user nova-compute[71516]:   <nova:owner>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:user uuid="343064f07762476ca5221be36dcbd0de">tempest-TaggedAttachmentsTest-2113709125-project-member</nova:user>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:project uuid="35fb372296e5430e9f915be720934494">tempest-TaggedAttachmentsTest-2113709125</nova:project>
Apr 11 23:07:19 user nova-compute[71516]:   </nova:owner>
Apr 11 23:07:19 user nova-compute[71516]:   <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:07:19 user nova-compute[71516]:   <nova:ports>
Apr 11 23:07:19 user nova-compute[71516]:     <nova:port uuid="ce46605b-463c-483c-9887-8923c6b74bbd">
Apr 11 23:07:19 user nova-compute[71516]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 23:07:19 user nova-compute[71516]:     </nova:port>
Apr 11 23:07:19 user nova-compute[71516]:   </nova:ports>
Apr 11 23:07:19 user nova-compute[71516]: </nova:instance>
Apr 11 23:07:19 user nova-compute[71516]:  {{(pid=71516) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[72edc5ad-f99b-47bf-93c1-efeec916d4b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:07:19 user nova-compute[71516]: No targets found.
Apr 11 23:07:19 user nova-compute[71516]: iSNS:
Apr 11 23:07:19 user nova-compute[71516]: No targets found.
Apr 11 23:07:19 user nova-compute[71516]: STATIC:
Apr 11 23:07:19 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a
Apr 11 23:07:19 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:19 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:19 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba
Apr 11 23:07:19 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:19 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:19 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405
Apr 11 23:07:19 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:19 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:19 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd
Apr 11 23:07:19 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:19 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:19 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc
Apr 11 23:07:19 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:19 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:19 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57
Apr 11 23:07:19 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:19 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:19 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3
Apr 11 23:07:19 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:19 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:19 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9
Apr 11 23:07:19 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:19 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:19 user nova-compute[71516]: FIRMWARE:
Apr 11 23:07:19 user nova-compute[71516]: No targets found.
Apr 11 23:07:19 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:07:19 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:07:19 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6021b026-6202-425e-8f01-05cab7c085d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4797b90-195a-4102-9185-1dd6b2d09857]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:19 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:19 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:19 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5419e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405'): ({'sdb'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Removing single pathed devices sdb {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec508678-a7f0-410e-a6c4-cd2db2de4c60]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c417b1b-3d2d-4414-90a9-2f4bc47229f9]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flushing IO for device /dev/sdb {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d122595-9fa2-4d59-88c8-cd1cbef1b6ff]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9294a20d-25b3-4f23-afaa-1be33bb2e7dd]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf21fb4ea-b392c80f0d1ed2c5', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f21fb4ea', '/dev/disk/by-id/scsi-26233393263383066') {{(pid=81691) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6246d4f7-133e-49ff-b90f-587cf9f68034]: (4, None) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d04fc59-d962-44ac-9f23-b1f4cbbe329b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc304e7c-1f98-4c48-8b1d-8653ac5fa4da]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405, portal: 172.16.0.220,3260]
Apr 11 23:07:19 user nova-compute[71516]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:19 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21161bfc-4b3c-46f4-84c1-24df3e42a405 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c437fd0a-a175-471b-8db7-efe1502f093f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== disconnect_volume: return (410ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:07:19 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Deleting instance files /opt/stack/data/nova/instances/f79fcca6-9f11-498f-b580-5681f9589a77_del
Apr 11 23:07:19 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Deletion of /opt/stack/data/nova/instances/f79fcca6-9f11-498f-b580-5681f9589a77_del complete
Apr 11 23:07:19 user nova-compute[71516]: INFO nova.compute.manager [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Took 1.31 seconds to destroy the instance on the hypervisor.
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.compute.manager [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-vif-deleted-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:19 user nova-compute[71516]: INFO nova.compute.manager [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Neutron deleted interface 85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230; detaching it from the instance and deleting it from the info cache
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.network.neutron [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Updating instance_info_cache with network_info: [{"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquired lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:07:19 user nova-compute[71516]: DEBUG nova.objects.instance [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] Lazy-loading 'system_metadata' on Instance uuid 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.objects.instance [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] Lazy-loading 'flavor' on Instance uuid 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1742434033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1742434033',id=8,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjYyFfjZ4jJzoYCxHNitzizXcyb+46lxif+p1WR3AxkPOuuDeeRO58EcoDOCV1AotgbxMzrZn7KKNU1EvmEh6aGyzyrtnw/YgTuT0xmESOl+oFG8zQeViLhG0BqUIwvWg==',key_name='tempest-keypair-1602402085',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35fb372296e5430e9f915be720934494',ramdisk_id='',reservation_id='r-4b344c26',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2113709125',owner_user_name='tempest-TaggedAttachmentsTest-2113709125-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343064f07762476ca5221be36dcbd0de',uuid=902899b9-8c8f-404e-a110-832b3c91d526,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.network.os_vif_util [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] Converting VIF {"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.network.os_vif_util [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e6:76,bridge_name='br-int',has_traffic_filtering=True,id=85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230,network=Network(878270a4-e4b7-4b97-8a78-2db5a6493445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d9a5fe-ae') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7c:e6:76"/><model type="virtio"/><mtu size="1442"/><target dev="tap85d9a5fe-ae"/></interface> {{(pid=71516) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7c:e6:76"/><model type="virtio"/><mtu size="1442"/><target dev="tap85d9a5fe-ae"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 11 23:07:20 user nova-compute[71516]:   <name>instance-00000008</name>
Apr 11 23:07:20 user nova-compute[71516]:   <uuid>902899b9-8c8f-404e-a110-832b3c91d526</uuid>
Apr 11 23:07:20 user nova-compute[71516]:   <metadata>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:07:20 user nova-compute[71516]:   <nova:package version="0.0.0"/>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:name>tempest-device-tagging-server-1742434033</nova:name>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:creationTime>2023-04-11 23:07:19</nova:creationTime>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:flavor name="m1.nano">
Apr 11 23:07:20 user nova-compute[71516]:     <nova:memory>128</nova:memory>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:disk>1</nova:disk>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:swap>0</nova:swap>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:vcpus>1</nova:vcpus>
Apr 11 23:07:20 user nova-compute[71516]:   </nova:flavor>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:owner>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:user uuid="343064f07762476ca5221be36dcbd0de">tempest-TaggedAttachmentsTest-2113709125-project-member</nova:user>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:project uuid="35fb372296e5430e9f915be720934494">tempest-TaggedAttachmentsTest-2113709125</nova:project>
Apr 11 23:07:20 user nova-compute[71516]:   </nova:owner>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:ports>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:port uuid="ce46605b-463c-483c-9887-8923c6b74bbd">
Apr 11 23:07:20 user nova-compute[71516]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 23:07:20 user nova-compute[71516]:     </nova:port>
Apr 11 23:07:20 user nova-compute[71516]:   </nova:ports>
Apr 11 23:07:20 user nova-compute[71516]: </nova:instance>
Apr 11 23:07:20 user nova-compute[71516]:   </metadata>
Apr 11 23:07:20 user nova-compute[71516]:   <memory unit='KiB'>131072</memory>
Apr 11 23:07:20 user nova-compute[71516]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 23:07:20 user nova-compute[71516]:   <vcpu placement='static'>1</vcpu>
Apr 11 23:07:20 user nova-compute[71516]:   <resource>
Apr 11 23:07:20 user nova-compute[71516]:     <partition>/machine</partition>
Apr 11 23:07:20 user nova-compute[71516]:   </resource>
Apr 11 23:07:20 user nova-compute[71516]:   <sysinfo type='smbios'>
Apr 11 23:07:20 user nova-compute[71516]:     <system>
Apr 11 23:07:20 user nova-compute[71516]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 23:07:20 user nova-compute[71516]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 23:07:20 user nova-compute[71516]:       <entry name='version'>0.0.0</entry>
Apr 11 23:07:20 user nova-compute[71516]:       <entry name='serial'>902899b9-8c8f-404e-a110-832b3c91d526</entry>
Apr 11 23:07:20 user nova-compute[71516]:       <entry name='uuid'>902899b9-8c8f-404e-a110-832b3c91d526</entry>
Apr 11 23:07:20 user nova-compute[71516]:       <entry name='family'>Virtual Machine</entry>
Apr 11 23:07:20 user nova-compute[71516]:     </system>
Apr 11 23:07:20 user nova-compute[71516]:   </sysinfo>
Apr 11 23:07:20 user nova-compute[71516]:   <os>
Apr 11 23:07:20 user nova-compute[71516]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 23:07:20 user nova-compute[71516]:     <boot dev='hd'/>
Apr 11 23:07:20 user nova-compute[71516]:     <smbios mode='sysinfo'/>
Apr 11 23:07:20 user nova-compute[71516]:   </os>
Apr 11 23:07:20 user nova-compute[71516]:   <features>
Apr 11 23:07:20 user nova-compute[71516]:     <acpi/>
Apr 11 23:07:20 user nova-compute[71516]:     <apic/>
Apr 11 23:07:20 user nova-compute[71516]:     <vmcoreinfo state='on'/>
Apr 11 23:07:20 user nova-compute[71516]:   </features>
Apr 11 23:07:20 user nova-compute[71516]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 23:07:20 user nova-compute[71516]:     <model fallback='forbid'>Nehalem</model>
Apr 11 23:07:20 user nova-compute[71516]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 23:07:20 user nova-compute[71516]:     <feature policy='require' name='vme'/>
Apr 11 23:07:20 user nova-compute[71516]:     <feature policy='require' name='x2apic'/>
Apr 11 23:07:20 user nova-compute[71516]:     <feature policy='require' name='hypervisor'/>
Apr 11 23:07:20 user nova-compute[71516]:   </cpu>
Apr 11 23:07:20 user nova-compute[71516]:   <clock offset='utc'>
Apr 11 23:07:20 user nova-compute[71516]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 23:07:20 user nova-compute[71516]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 23:07:20 user nova-compute[71516]:     <timer name='hpet' present='no'/>
Apr 11 23:07:20 user nova-compute[71516]:   </clock>
Apr 11 23:07:20 user nova-compute[71516]:   <on_poweroff>destroy</on_poweroff>
Apr 11 23:07:20 user nova-compute[71516]:   <on_reboot>restart</on_reboot>
Apr 11 23:07:20 user nova-compute[71516]:   <on_crash>destroy</on_crash>
Apr 11 23:07:20 user nova-compute[71516]:   <devices>
Apr 11 23:07:20 user nova-compute[71516]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 23:07:20 user nova-compute[71516]:     <disk type='file' device='disk'>
Apr 11 23:07:20 user nova-compute[71516]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 23:07:20 user nova-compute[71516]:       <source file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk' index='2'/>
Apr 11 23:07:20 user nova-compute[71516]:       <backingStore type='file' index='3'>
Apr 11 23:07:20 user nova-compute[71516]:         <format type='raw'/>
Apr 11 23:07:20 user nova-compute[71516]:         <source file='/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4'/>
Apr 11 23:07:20 user nova-compute[71516]:         <backingStore/>
Apr 11 23:07:20 user nova-compute[71516]:       </backingStore>
Apr 11 23:07:20 user nova-compute[71516]:       <target dev='vda' bus='virtio'/>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='virtio-disk0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </disk>
Apr 11 23:07:20 user nova-compute[71516]:     <disk type='file' device='cdrom'>
Apr 11 23:07:20 user nova-compute[71516]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 23:07:20 user nova-compute[71516]:       <source file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk.config' index='1'/>
Apr 11 23:07:20 user nova-compute[71516]:       <backingStore/>
Apr 11 23:07:20 user nova-compute[71516]:       <target dev='hda' bus='ide'/>
Apr 11 23:07:20 user nova-compute[71516]:       <readonly/>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='ide0-0-0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </disk>
Apr 11 23:07:20 user nova-compute[71516]:     <controller type='usb' index='0' model='none'>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='usb'/>
Apr 11 23:07:20 user nova-compute[71516]:     </controller>
Apr 11 23:07:20 user nova-compute[71516]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='pci.0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </controller>
Apr 11 23:07:20 user nova-compute[71516]:     <controller type='ide' index='0'>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='ide'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 23:07:20 user nova-compute[71516]:     </controller>
Apr 11 23:07:20 user nova-compute[71516]:     <interface type='ethernet'>
Apr 11 23:07:20 user nova-compute[71516]:       <mac address='fa:16:3e:da:ae:a2'/>
Apr 11 23:07:20 user nova-compute[71516]:       <target dev='tapce46605b-46'/>
Apr 11 23:07:20 user nova-compute[71516]:       <model type='virtio'/>
Apr 11 23:07:20 user nova-compute[71516]:       <mtu size='1442'/>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='net0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </interface>
Apr 11 23:07:20 user nova-compute[71516]:     <serial type='pty'>
Apr 11 23:07:20 user nova-compute[71516]:       <source path='/dev/pts/7'/>
Apr 11 23:07:20 user nova-compute[71516]:       <log file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/console.log' append='off'/>
Apr 11 23:07:20 user nova-compute[71516]:       <target type='isa-serial' port='0'>
Apr 11 23:07:20 user nova-compute[71516]:         <model name='isa-serial'/>
Apr 11 23:07:20 user nova-compute[71516]:       </target>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='serial0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </serial>
Apr 11 23:07:20 user nova-compute[71516]:     <console type='pty' tty='/dev/pts/7'>
Apr 11 23:07:20 user nova-compute[71516]:       <source path='/dev/pts/7'/>
Apr 11 23:07:20 user nova-compute[71516]:       <log file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/console.log' append='off'/>
Apr 11 23:07:20 user nova-compute[71516]:       <target type='serial' port='0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='serial0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </console>
Apr 11 23:07:20 user nova-compute[71516]:     <input type='mouse' bus='ps2'>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='input0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </input>
Apr 11 23:07:20 user nova-compute[71516]:     <input type='keyboard' bus='ps2'>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='input1'/>
Apr 11 23:07:20 user nova-compute[71516]:     </input>
Apr 11 23:07:20 user nova-compute[71516]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 11 23:07:20 user nova-compute[71516]:       <listen type='address' address='0.0.0.0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </graphics>
Apr 11 23:07:20 user nova-compute[71516]:     <audio id='1' type='none'/>
Apr 11 23:07:20 user nova-compute[71516]:     <video>
Apr 11 23:07:20 user nova-compute[71516]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='video0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </video>
Apr 11 23:07:20 user nova-compute[71516]:     <memballoon model='virtio'>
Apr 11 23:07:20 user nova-compute[71516]:       <stats period='10'/>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='balloon0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </memballoon>
Apr 11 23:07:20 user nova-compute[71516]:     <rng model='virtio'>
Apr 11 23:07:20 user nova-compute[71516]:       <backend model='random'>/dev/urandom</backend>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='rng0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </rng>
Apr 11 23:07:20 user nova-compute[71516]:   </devices>
Apr 11 23:07:20 user nova-compute[71516]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 23:07:20 user nova-compute[71516]:     <label>libvirt-902899b9-8c8f-404e-a110-832b3c91d526</label>
Apr 11 23:07:20 user nova-compute[71516]:     <imagelabel>libvirt-902899b9-8c8f-404e-a110-832b3c91d526</imagelabel>
Apr 11 23:07:20 user nova-compute[71516]:   </seclabel>
Apr 11 23:07:20 user nova-compute[71516]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 23:07:20 user nova-compute[71516]:     <label>+64055:+108</label>
Apr 11 23:07:20 user nova-compute[71516]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 23:07:20 user nova-compute[71516]:   </seclabel>
Apr 11 23:07:20 user nova-compute[71516]: </domain>
Apr 11 23:07:20 user nova-compute[71516]:  {{(pid=71516) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7c:e6:76"/><model type="virtio"/><mtu size="1442"/><target dev="tap85d9a5fe-ae"/></interface> {{(pid=71516) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7c:e6:76"/><model type="virtio"/><mtu size="1442"/><target dev="tap85d9a5fe-ae"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 11 23:07:20 user nova-compute[71516]:   <name>instance-00000008</name>
Apr 11 23:07:20 user nova-compute[71516]:   <uuid>902899b9-8c8f-404e-a110-832b3c91d526</uuid>
Apr 11 23:07:20 user nova-compute[71516]:   <metadata>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:07:20 user nova-compute[71516]:   <nova:package version="0.0.0"/>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:name>tempest-device-tagging-server-1742434033</nova:name>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:creationTime>2023-04-11 23:07:19</nova:creationTime>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:flavor name="m1.nano">
Apr 11 23:07:20 user nova-compute[71516]:     <nova:memory>128</nova:memory>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:disk>1</nova:disk>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:swap>0</nova:swap>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:vcpus>1</nova:vcpus>
Apr 11 23:07:20 user nova-compute[71516]:   </nova:flavor>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:owner>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:user uuid="343064f07762476ca5221be36dcbd0de">tempest-TaggedAttachmentsTest-2113709125-project-member</nova:user>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:project uuid="35fb372296e5430e9f915be720934494">tempest-TaggedAttachmentsTest-2113709125</nova:project>
Apr 11 23:07:20 user nova-compute[71516]:   </nova:owner>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:ports>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:port uuid="ce46605b-463c-483c-9887-8923c6b74bbd">
Apr 11 23:07:20 user nova-compute[71516]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 23:07:20 user nova-compute[71516]:     </nova:port>
Apr 11 23:07:20 user nova-compute[71516]:   </nova:ports>
Apr 11 23:07:20 user nova-compute[71516]: </nova:instance>
Apr 11 23:07:20 user nova-compute[71516]:   </metadata>
Apr 11 23:07:20 user nova-compute[71516]:   <memory unit='KiB'>131072</memory>
Apr 11 23:07:20 user nova-compute[71516]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 23:07:20 user nova-compute[71516]:   <vcpu placement='static'>1</vcpu>
Apr 11 23:07:20 user nova-compute[71516]:   <resource>
Apr 11 23:07:20 user nova-compute[71516]:     <partition>/machine</partition>
Apr 11 23:07:20 user nova-compute[71516]:   </resource>
Apr 11 23:07:20 user nova-compute[71516]:   <sysinfo type='smbios'>
Apr 11 23:07:20 user nova-compute[71516]:     <system>
Apr 11 23:07:20 user nova-compute[71516]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 23:07:20 user nova-compute[71516]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 23:07:20 user nova-compute[71516]:       <entry name='version'>0.0.0</entry>
Apr 11 23:07:20 user nova-compute[71516]:       <entry name='serial'>902899b9-8c8f-404e-a110-832b3c91d526</entry>
Apr 11 23:07:20 user nova-compute[71516]:       <entry name='uuid'>902899b9-8c8f-404e-a110-832b3c91d526</entry>
Apr 11 23:07:20 user nova-compute[71516]:       <entry name='family'>Virtual Machine</entry>
Apr 11 23:07:20 user nova-compute[71516]:     </system>
Apr 11 23:07:20 user nova-compute[71516]:   </sysinfo>
Apr 11 23:07:20 user nova-compute[71516]:   <os>
Apr 11 23:07:20 user nova-compute[71516]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 23:07:20 user nova-compute[71516]:     <boot dev='hd'/>
Apr 11 23:07:20 user nova-compute[71516]:     <smbios mode='sysinfo'/>
Apr 11 23:07:20 user nova-compute[71516]:   </os>
Apr 11 23:07:20 user nova-compute[71516]:   <features>
Apr 11 23:07:20 user nova-compute[71516]:     <acpi/>
Apr 11 23:07:20 user nova-compute[71516]:     <apic/>
Apr 11 23:07:20 user nova-compute[71516]:     <vmcoreinfo state='on'/>
Apr 11 23:07:20 user nova-compute[71516]:   </features>
Apr 11 23:07:20 user nova-compute[71516]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 23:07:20 user nova-compute[71516]:     <model fallback='forbid'>Nehalem</model>
Apr 11 23:07:20 user nova-compute[71516]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 23:07:20 user nova-compute[71516]:     <feature policy='require' name='vme'/>
Apr 11 23:07:20 user nova-compute[71516]:     <feature policy='require' name='x2apic'/>
Apr 11 23:07:20 user nova-compute[71516]:     <feature policy='require' name='hypervisor'/>
Apr 11 23:07:20 user nova-compute[71516]:   </cpu>
Apr 11 23:07:20 user nova-compute[71516]:   <clock offset='utc'>
Apr 11 23:07:20 user nova-compute[71516]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 23:07:20 user nova-compute[71516]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 23:07:20 user nova-compute[71516]:     <timer name='hpet' present='no'/>
Apr 11 23:07:20 user nova-compute[71516]:   </clock>
Apr 11 23:07:20 user nova-compute[71516]:   <on_poweroff>destroy</on_poweroff>
Apr 11 23:07:20 user nova-compute[71516]:   <on_reboot>restart</on_reboot>
Apr 11 23:07:20 user nova-compute[71516]:   <on_crash>destroy</on_crash>
Apr 11 23:07:20 user nova-compute[71516]:   <devices>
Apr 11 23:07:20 user nova-compute[71516]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 23:07:20 user nova-compute[71516]:     <disk type='file' device='disk'>
Apr 11 23:07:20 user nova-compute[71516]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 23:07:20 user nova-compute[71516]:       <source file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk' index='2'/>
Apr 11 23:07:20 user nova-compute[71516]:       <backingStore type='file' index='3'>
Apr 11 23:07:20 user nova-compute[71516]:         <format type='raw'/>
Apr 11 23:07:20 user nova-compute[71516]:         <source file='/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4'/>
Apr 11 23:07:20 user nova-compute[71516]:         <backingStore/>
Apr 11 23:07:20 user nova-compute[71516]:       </backingStore>
Apr 11 23:07:20 user nova-compute[71516]:       <target dev='vda' bus='virtio'/>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='virtio-disk0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </disk>
Apr 11 23:07:20 user nova-compute[71516]:     <disk type='file' device='cdrom'>
Apr 11 23:07:20 user nova-compute[71516]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 23:07:20 user nova-compute[71516]:       <source file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk.config' index='1'/>
Apr 11 23:07:20 user nova-compute[71516]:       <backingStore/>
Apr 11 23:07:20 user nova-compute[71516]:       <target dev='hda' bus='ide'/>
Apr 11 23:07:20 user nova-compute[71516]:       <readonly/>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='ide0-0-0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </disk>
Apr 11 23:07:20 user nova-compute[71516]:     <controller type='usb' index='0' model='none'>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='usb'/>
Apr 11 23:07:20 user nova-compute[71516]:     </controller>
Apr 11 23:07:20 user nova-compute[71516]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='pci.0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </controller>
Apr 11 23:07:20 user nova-compute[71516]:     <controller type='ide' index='0'>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='ide'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 23:07:20 user nova-compute[71516]:     </controller>
Apr 11 23:07:20 user nova-compute[71516]:     <interface type='ethernet'>
Apr 11 23:07:20 user nova-compute[71516]:       <mac address='fa:16:3e:da:ae:a2'/>
Apr 11 23:07:20 user nova-compute[71516]:       <target dev='tapce46605b-46'/>
Apr 11 23:07:20 user nova-compute[71516]:       <model type='virtio'/>
Apr 11 23:07:20 user nova-compute[71516]:       <mtu size='1442'/>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='net0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </interface>
Apr 11 23:07:20 user nova-compute[71516]:     <serial type='pty'>
Apr 11 23:07:20 user nova-compute[71516]:       <source path='/dev/pts/7'/>
Apr 11 23:07:20 user nova-compute[71516]:       <log file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/console.log' append='off'/>
Apr 11 23:07:20 user nova-compute[71516]:       <target type='isa-serial' port='0'>
Apr 11 23:07:20 user nova-compute[71516]:         <model name='isa-serial'/>
Apr 11 23:07:20 user nova-compute[71516]:       </target>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='serial0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </serial>
Apr 11 23:07:20 user nova-compute[71516]:     <console type='pty' tty='/dev/pts/7'>
Apr 11 23:07:20 user nova-compute[71516]:       <source path='/dev/pts/7'/>
Apr 11 23:07:20 user nova-compute[71516]:       <log file='/opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/console.log' append='off'/>
Apr 11 23:07:20 user nova-compute[71516]:       <target type='serial' port='0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='serial0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </console>
Apr 11 23:07:20 user nova-compute[71516]:     <input type='mouse' bus='ps2'>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='input0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </input>
Apr 11 23:07:20 user nova-compute[71516]:     <input type='keyboard' bus='ps2'>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='input1'/>
Apr 11 23:07:20 user nova-compute[71516]:     </input>
Apr 11 23:07:20 user nova-compute[71516]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 11 23:07:20 user nova-compute[71516]:       <listen type='address' address='0.0.0.0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </graphics>
Apr 11 23:07:20 user nova-compute[71516]:     <audio id='1' type='none'/>
Apr 11 23:07:20 user nova-compute[71516]:     <video>
Apr 11 23:07:20 user nova-compute[71516]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='video0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </video>
Apr 11 23:07:20 user nova-compute[71516]:     <memballoon model='virtio'>
Apr 11 23:07:20 user nova-compute[71516]:       <stats period='10'/>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='balloon0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </memballoon>
Apr 11 23:07:20 user nova-compute[71516]:     <rng model='virtio'>
Apr 11 23:07:20 user nova-compute[71516]:       <backend model='random'>/dev/urandom</backend>
Apr 11 23:07:20 user nova-compute[71516]:       <alias name='rng0'/>
Apr 11 23:07:20 user nova-compute[71516]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 23:07:20 user nova-compute[71516]:     </rng>
Apr 11 23:07:20 user nova-compute[71516]:   </devices>
Apr 11 23:07:20 user nova-compute[71516]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 23:07:20 user nova-compute[71516]:     <label>libvirt-902899b9-8c8f-404e-a110-832b3c91d526</label>
Apr 11 23:07:20 user nova-compute[71516]:     <imagelabel>libvirt-902899b9-8c8f-404e-a110-832b3c91d526</imagelabel>
Apr 11 23:07:20 user nova-compute[71516]:   </seclabel>
Apr 11 23:07:20 user nova-compute[71516]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 23:07:20 user nova-compute[71516]:     <label>+64055:+108</label>
Apr 11 23:07:20 user nova-compute[71516]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 23:07:20 user nova-compute[71516]:   </seclabel>
Apr 11 23:07:20 user nova-compute[71516]: </domain>
Apr 11 23:07:20 user nova-compute[71516]:  {{(pid=71516) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 23:07:20 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Detaching interface fa:16:3e:7c:e6:76 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap85d9a5fe-ae' not found.
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1742434033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1742434033',id=8,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjYyFfjZ4jJzoYCxHNitzizXcyb+46lxif+p1WR3AxkPOuuDeeRO58EcoDOCV1AotgbxMzrZn7KKNU1EvmEh6aGyzyrtnw/YgTuT0xmESOl+oFG8zQeViLhG0BqUIwvWg==',key_name='tempest-keypair-1602402085',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35fb372296e5430e9f915be720934494',ramdisk_id='',reservation_id='r-4b344c26',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2113709125',owner_user_name='tempest-TaggedAttachmentsTest-2113709125-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343064f07762476ca5221be36dcbd0de',uuid=902899b9-8c8f-404e-a110-832b3c91d526,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.network.os_vif_util [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] Converting VIF {"id": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "address": "fa:16:3e:7c:e6:76", "network": {"id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-312881233", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d9a5fe-ae", "ovs_interfaceid": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.network.os_vif_util [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e6:76,bridge_name='br-int',has_traffic_filtering=True,id=85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230,network=Network(878270a4-e4b7-4b97-8a78-2db5a6493445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d9a5fe-ae') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG os_vif [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e6:76,bridge_name='br-int',has_traffic_filtering=True,id=85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230,network=Network(878270a4-e4b7-4b97-8a78-2db5a6493445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d9a5fe-ae') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85d9a5fe-ae, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:07:20 user nova-compute[71516]: INFO os_vif [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e6:76,bridge_name='br-int',has_traffic_filtering=True,id=85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230,network=Network(878270a4-e4b7-4b97-8a78-2db5a6493445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d9a5fe-ae')
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:07:20 user nova-compute[71516]:   <nova:package version="0.0.0"/>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:name>tempest-device-tagging-server-1742434033</nova:name>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:creationTime>2023-04-11 23:07:20</nova:creationTime>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:flavor name="m1.nano">
Apr 11 23:07:20 user nova-compute[71516]:     <nova:memory>128</nova:memory>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:disk>1</nova:disk>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:swap>0</nova:swap>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:vcpus>1</nova:vcpus>
Apr 11 23:07:20 user nova-compute[71516]:   </nova:flavor>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:owner>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:user uuid="343064f07762476ca5221be36dcbd0de">tempest-TaggedAttachmentsTest-2113709125-project-member</nova:user>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:project uuid="35fb372296e5430e9f915be720934494">tempest-TaggedAttachmentsTest-2113709125</nova:project>
Apr 11 23:07:20 user nova-compute[71516]:   </nova:owner>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:07:20 user nova-compute[71516]:   <nova:ports>
Apr 11 23:07:20 user nova-compute[71516]:     <nova:port uuid="ce46605b-463c-483c-9887-8923c6b74bbd">
Apr 11 23:07:20 user nova-compute[71516]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 23:07:20 user nova-compute[71516]:     </nova:port>
Apr 11 23:07:20 user nova-compute[71516]:   </nova:ports>
Apr 11 23:07:20 user nova-compute[71516]: </nova:instance>
Apr 11 23:07:20 user nova-compute[71516]:  {{(pid=71516) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:20 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Took 0.98 seconds to deallocate network for instance.
Apr 11 23:07:20 user nova-compute[71516]: INFO nova.network.neutron [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Port 85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Updating instance_info_cache with network_info: [{"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Releasing lock "refresh_cache-902899b9-8c8f-404e-a110-832b3c91d526" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Received event network-vif-plugged-1c726827-fb42-4618-ac03-9051705301a0 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Acquiring lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Lock "f79fcca6-9f11-498f-b580-5681f9589a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] No waiting events found dispatching network-vif-plugged-1c726827-fb42-4618-ac03-9051705301a0 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:20 user nova-compute[71516]: WARNING nova.compute.manager [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Received unexpected event network-vif-plugged-1c726827-fb42-4618-ac03-9051705301a0 for instance with vm_state active and task_state deleting.
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-vif-unplugged-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] No waiting events found dispatching network-vif-unplugged-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:20 user nova-compute[71516]: WARNING nova.compute.manager [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received unexpected event network-vif-unplugged-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 for instance with vm_state active and task_state None.
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-vif-plugged-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] No waiting events found dispatching network-vif-plugged-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:20 user nova-compute[71516]: WARNING nova.compute.manager [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received unexpected event network-vif-plugged-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 for instance with vm_state active and task_state None.
Apr 11 23:07:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "interface-902899b9-8c8f-404e-a110-832b3c91d526-85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.019s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:21 user nova-compute[71516]: INFO nova.compute.manager [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Took 0.81 seconds to detach 1 volumes for instance.
Apr 11 23:07:21 user nova-compute[71516]: DEBUG nova.compute.manager [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Deleting volume: 21161bfc-4b3c-46f4-84c1-24df3e42a405 {{(pid=71516) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 23:07:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Received event network-vif-deleted-1c726827-fb42-4618-ac03-9051705301a0 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-changed-53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing instance network info cache due to event network-changed-53ff16a9-5f97-4d83-9b59-7ce5c337f392. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:07:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] Acquiring lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:07:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] Acquired lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:07:21 user nova-compute[71516]: DEBUG nova.network.neutron [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Refreshing network info cache for port 53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:22 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Deleted allocations for instance f79fcca6-9f11-498f-b580-5681f9589a77
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "f79fcca6-9f11-498f-b580-5681f9589a77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.803s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG nova.compute.manager [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLZoeWMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5d6517f0-c4f0-4b35-a94a-610058ecc687', 'attached_at': '', 'detached_at': '', 'volume_id': '5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 'serial': '5041ddaf-d487-479c-a3e7-a06d7bdae1a6'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGYTRovw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'be9133e2-d785-4ec4-b4a1-843e8def60ba'}, 'status': 'reserved', 'instance': '5d6517f0-c4f0-4b35-a94a-610058ecc687', 'attached_at': '', 'detached_at': '', 'volume_id': 'be9133e2-d785-4ec4-b4a1-843e8def60ba', 'serial'} {{(pid=71516) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLZoeWMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:22 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:22 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:22 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1960a58b-c6e2-4566-9289-2a072f75a347]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:07:22 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c71001-7336-4b62-aa44-cf7e64d1fd87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6] added
Apr 11 23:07:22 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15426e4-f5e9-4433-8a4b-151e0af64b1f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[669b54c4-b892-4209-bd57-a81313caa820]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLZoeWMa {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLZoeWMa" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[430bc759-4610-4453-80a6-ab9527442cea]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mLZoeWMa'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0dd41f-5a3a-4d70-9128-a443a08f338e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[33320ffe-6cc5-4498-af80-00ec6c25c8fb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:22 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:22 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd666f9-c7e2-4130-be6d-3681fc5ae5ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260]
Apr 11 23:07:22 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:22 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aff0e92-75d4-4269-9cf9-1774b0724c5e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd4cd4c-7e87-46a7-a7d6-e5ee11c1e65f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:22 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:22 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:23 user nova-compute[71516]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:23 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:23 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:23 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:23 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:23 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:23 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:23 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG nova.network.neutron [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updated VIF entry in instance network info cache for port 53ff16a9-5f97-4d83-9b59-7ce5c337f392. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG nova.network.neutron [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [{"id": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "address": "fa:16:3e:d7:2d:8b", "network": {"id": "a341e6d3-4f4c-44c5-a510-cd0b61eb81cd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-604450370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ff16a9-5f", "ovs_interfaceid": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5296123e-0b05-4e29-b252-6e2db7395f78", "address": "fa:16:3e:90:c9:63", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296123e-0b", "ovs_interfaceid": "5296123e-0b05-4e29-b252-6e2db7395f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f33eab0-24a6-4b19-b807-4e762cfbc68e]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLZoeWMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] Releasing lock "refresh_cache-89644573-5fbc-4ab4-a16b-23b7c4f6c598" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:23 user nova-compute[71516]: INFO nova.compute.manager [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Terminating instance
Apr 11 23:07:23 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23363303530336261', 'path': '/dev/sdb'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363303530336261', 'path': '/dev/sdb'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-changed-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing instance network info cache due to event network-changed-5469ebfb-ee6b-49b3-9ae9-35423e6254a1. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] Acquiring lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] Acquired lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.network.neutron [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Refreshing network info cache for port 5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.objects.instance [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lazy-loading 'flavor' on Instance uuid 5d6517f0-c4f0-4b35-a94a-610058ecc687 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-719035aa-c370-4c0c-b599-7ad3e9e550ad req-17be6c10-fd04-4e1f-9569-3a9df6275ee3 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-719035aa-c370-4c0c-b599-7ad3e9e550ad req-17be6c10-fd04-4e1f-9569-3a9df6275ee3 service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-719035aa-c370-4c0c-b599-7ad3e9e550ad req-17be6c10-fd04-4e1f-9569-3a9df6275ee3 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-719035aa-c370-4c0c-b599-7ad3e9e550ad req-17be6c10-fd04-4e1f-9569-3a9df6275ee3 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-719035aa-c370-4c0c-b599-7ad3e9e550ad req-17be6c10-fd04-4e1f-9569-3a9df6275ee3 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-unplugged-53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-719035aa-c370-4c0c-b599-7ad3e9e550ad req-17be6c10-fd04-4e1f-9569-3a9df6275ee3 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-53ff16a9-5f97-4d83-9b59-7ce5c337f392 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-558a0113-9b58-44b7-a9f5-7fc790cc1b4f req-d78790a2-97d1-465e-a4f9-e2d7b2c4df16 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-558a0113-9b58-44b7-a9f5-7fc790cc1b4f req-d78790a2-97d1-465e-a4f9-e2d7b2c4df16 service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-558a0113-9b58-44b7-a9f5-7fc790cc1b4f req-d78790a2-97d1-465e-a4f9-e2d7b2c4df16 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-558a0113-9b58-44b7-a9f5-7fc790cc1b4f req-d78790a2-97d1-465e-a4f9-e2d7b2c4df16 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-558a0113-9b58-44b7-a9f5-7fc790cc1b4f req-d78790a2-97d1-465e-a4f9-e2d7b2c4df16 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-unplugged-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-558a0113-9b58-44b7-a9f5-7fc790cc1b4f req-d78790a2-97d1-465e-a4f9-e2d7b2c4df16 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:25 user nova-compute[71516]: INFO nova.compute.manager [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Terminating instance
Apr 11 23:07:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 146800640 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 309329920 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.network.neutron [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updated VIF entry in instance network info cache for port 5469ebfb-ee6b-49b3-9ae9-35423e6254a1. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.network.neutron [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating instance_info_cache with network_info: [{"id": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "address": "fa:16:3e:50:71:df", "network": {"id": "d9a27961-c537-4aa6-9fba-dbd50ba4d719", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1712790655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5469ebfb-ee", "ovs_interfaceid": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dc3835d-017b-4411-a70a-c538768a13b7", "address": "fa:16:3e:5a:b7:bd", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc3835d-01", "ovs_interfaceid": "0dc3835d-017b-4411-a70a-c538768a13b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] Releasing lock "refresh_cache-f59cffaa-b1e0-427d-b395-1043bad9a5c7" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bac12093-1793-4547-8fb6-627879ffb839 req-7501a951-c19a-4b2a-979a-280039fb4720 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-86246915-cf00-43be-b433-01b4ed88252c {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bac12093-1793-4547-8fb6-627879ffb839 req-7501a951-c19a-4b2a-979a-280039fb4720 service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bac12093-1793-4547-8fb6-627879ffb839 req-7501a951-c19a-4b2a-979a-280039fb4720 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bac12093-1793-4547-8fb6-627879ffb839 req-7501a951-c19a-4b2a-979a-280039fb4720 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bac12093-1793-4547-8fb6-627879ffb839 req-7501a951-c19a-4b2a-979a-280039fb4720 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-unplugged-86246915-cf00-43be-b433-01b4ed88252c {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bac12093-1793-4547-8fb6-627879ffb839 req-7501a951-c19a-4b2a-979a-280039fb4720 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-86246915-cf00-43be-b433-01b4ed88252c for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:26 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Instance destroyed successfully.
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.objects.instance [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lazy-loading 'resources' on Instance uuid 89644573-5fbc-4ab4-a16b-23b7c4f6c598 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 479199232 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "address": "fa:16:3e:d7:2d:8b", "network": {"id": "a341e6d3-4f4c-44c5-a510-cd0b61eb81cd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-604450370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ff16a9-5f", "ovs_interfaceid": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "address": "fa:16:3e:d7:2d:8b", "network": {"id": "a341e6d3-4f4c-44c5-a510-cd0b61eb81cd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-604450370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ff16a9-5f", "ovs_interfaceid": "53ff16a9-5f97-4d83-9b59-7ce5c337f392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=53ff16a9-5f97-4d83-9b59-7ce5c337f392,network=Network(a341e6d3-4f4c-44c5-a510-cd0b61eb81cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ff16a9-5f') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=53ff16a9-5f97-4d83-9b59-7ce5c337f392,network=Network(a341e6d3-4f4c-44c5-a510-cd0b61eb81cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ff16a9-5f') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53ff16a9-5f, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updating instance_info_cache with network_info: [{"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:26 user nova-compute[71516]: WARNING nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-53ff16a9-5f97-4d83-9b59-7ce5c337f392 for instance with vm_state active and task_state deleting.
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-39a39a5d-8b30-4e73-893d-323dbde1de9f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-unplugged-39a39a5d-8b30-4e73-893d-323dbde1de9f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-39a39a5d-8b30-4e73-893d-323dbde1de9f for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-39a39a5d-8b30-4e73-893d-323dbde1de9f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-39a39a5d-8b30-4e73-893d-323dbde1de9f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:26 user nova-compute[71516]: WARNING nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-39a39a5d-8b30-4e73-893d-323dbde1de9f for instance with vm_state active and task_state deleting.
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-5296123e-0b05-4e29-b252-6e2db7395f78 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-unplugged-5296123e-0b05-4e29-b252-6e2db7395f78 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-5296123e-0b05-4e29-b252-6e2db7395f78 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-5296123e-0b05-4e29-b252-6e2db7395f78 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-5296123e-0b05-4e29-b252-6e2db7395f78 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:26 user nova-compute[71516]: WARNING nova.compute.manager [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-5296123e-0b05-4e29-b252-6e2db7395f78 for instance with vm_state active and task_state deleting.
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: INFO os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=53ff16a9-5f97-4d83-9b59-7ce5c337f392,network=Network(a341e6d3-4f4c-44c5-a510-cd0b61eb81cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ff16a9-5f')
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:64:78,bridge_name='br-int',has_traffic_filtering=True,id=9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9486eb92-5c') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:64:78,bridge_name='br-int',has_traffic_filtering=True,id=9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9486eb92-5c') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9486eb92-5c, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:26 user nova-compute[71516]: WARNING nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 for instance with vm_state active and task_state deleting.
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-4f2220da-1007-4ae8-9c12-73a142b02b49 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-unplugged-4f2220da-1007-4ae8-9c12-73a142b02b49 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-4f2220da-1007-4ae8-9c12-73a142b02b49 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-4f2220da-1007-4ae8-9c12-73a142b02b49 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-4f2220da-1007-4ae8-9c12-73a142b02b49 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:26 user nova-compute[71516]: WARNING nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-4f2220da-1007-4ae8-9c12-73a142b02b49 for instance with vm_state active and task_state deleting.
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-unplugged-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:26 user nova-compute[71516]: WARNING nova.compute.manager [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 for instance with vm_state active and task_state deleting.
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 650117120 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: INFO os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:64:78,bridge_name='br-int',has_traffic_filtering=True,id=9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9486eb92-5c')
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:fb:35,bridge_name='br-int',has_traffic_filtering=True,id=4f2220da-1007-4ae8-9c12-73a142b02b49,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f2220da-10') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:fb:35,bridge_name='br-int',has_traffic_filtering=True,id=4f2220da-1007-4ae8-9c12-73a142b02b49,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f2220da-10') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f2220da-10, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:07:27 user nova-compute[71516]: INFO os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:fb:35,bridge_name='br-int',has_traffic_filtering=True,id=4f2220da-1007-4ae8-9c12-73a142b02b49,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f2220da-10')
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:2b:54,bridge_name='br-int',has_traffic_filtering=True,id=86246915-cf00-43be-b433-01b4ed88252c,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86246915-cf') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:2b:54,bridge_name='br-int',has_traffic_filtering=True,id=86246915-cf00-43be-b433-01b4ed88252c,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86246915-cf') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86246915-cf, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 814743552 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:27 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Instance destroyed successfully.
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.objects.instance [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lazy-loading 'resources' on Instance uuid f59cffaa-b1e0-427d-b395-1043bad9a5c7 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "address": "fa:16:3e:50:71:df", "network": {"id": "d9a27961-c537-4aa6-9fba-dbd50ba4d719", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1712790655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5469ebfb-ee", "ovs_interfaceid": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "address": "fa:16:3e:50:71:df", "network": {"id": "d9a27961-c537-4aa6-9fba-dbd50ba4d719", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1712790655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5469ebfb-ee", "ovs_interfaceid": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:71:df,bridge_name='br-int',has_traffic_filtering=True,id=5469ebfb-ee6b-49b3-9ae9-35423e6254a1,network=Network(d9a27961-c537-4aa6-9fba-dbd50ba4d719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5469ebfb-ee') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:71:df,bridge_name='br-int',has_traffic_filtering=True,id=5469ebfb-ee6b-49b3-9ae9-35423e6254a1,network=Network(d9a27961-c537-4aa6-9fba-dbd50ba4d719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5469ebfb-ee') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5469ebfb-ee, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:27 user nova-compute[71516]: INFO os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:2b:54,bridge_name='br-int',has_traffic_filtering=True,id=86246915-cf00-43be-b433-01b4ed88252c,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86246915-cf')
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:a5:c1,bridge_name='br-int',has_traffic_filtering=True,id=39a39a5d-8b30-4e73-893d-323dbde1de9f,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a39a5d-8b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a5:c1,bridge_name='br-int',has_traffic_filtering=True,id=39a39a5d-8b30-4e73-893d-323dbde1de9f,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a39a5d-8b') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39a39a5d-8b, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:27 user nova-compute[71516]: INFO os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:71:df,bridge_name='br-int',has_traffic_filtering=True,id=5469ebfb-ee6b-49b3-9ae9-35423e6254a1,network=Network(d9a27961-c537-4aa6-9fba-dbd50ba4d719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5469ebfb-ee')
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=dd4aa184-e61f-4c14-bb1e-04e2b5c139ac,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd4aa184-e6') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=dd4aa184-e61f-4c14-bb1e-04e2b5c139ac,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd4aa184-e6') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 990904320 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd4aa184-e6, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:27 user nova-compute[71516]: INFO os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a5:c1,bridge_name='br-int',has_traffic_filtering=True,id=39a39a5d-8b30-4e73-893d-323dbde1de9f,network=Network(a781604b-df59-4e97-af90-76111c0cda1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a39a5d-8b')
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5296123e-0b05-4e29-b252-6e2db7395f78", "address": "fa:16:3e:90:c9:63", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296123e-0b", "ovs_interfaceid": "5296123e-0b05-4e29-b252-6e2db7395f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "5296123e-0b05-4e29-b252-6e2db7395f78", "address": "fa:16:3e:90:c9:63", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296123e-0b", "ovs_interfaceid": "5296123e-0b05-4e29-b252-6e2db7395f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5296123e-0b05-4e29-b252-6e2db7395f78,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296123e-0b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5296123e-0b05-4e29-b252-6e2db7395f78,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296123e-0b') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5296123e-0b, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:28 user nova-compute[71516]: INFO os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=dd4aa184-e61f-4c14-bb1e-04e2b5c139ac,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd4aa184-e6')
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:90:c1,bridge_name='br-int',has_traffic_filtering=True,id=94d3ede6-25a2-498c-8b67-412a4b84272c,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94d3ede6-25') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:90:c1,bridge_name='br-int',has_traffic_filtering=True,id=94d3ede6-25a2-498c-8b67-412a4b84272c,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94d3ede6-25') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94d3ede6-25, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:28 user nova-compute[71516]: INFO os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5296123e-0b05-4e29-b252-6e2db7395f78,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296123e-0b')
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1545591213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1545591213',id=10,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w==',key_name='tempest-keypair-1302009898',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2ea0b8c8a4b4a1cac18e97464975fab',ramdisk_id='',reservation_id='r-2p8efsjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-604376384',owner_user_name='tempest-TaggedBootDevicesTest_v242-604376384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6c3f5f97f8d4380a97913a14fda79df',uuid=89644573-5fbc-4ab4-a16b-23b7c4f6c598,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converting VIF {"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:55:85,bridge_name='br-int',has_traffic_filtering=True,id=d29edb78-cc5a-4e48-81af-a915190376af,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29edb78-cc') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:55:85,bridge_name='br-int',has_traffic_filtering=True,id=d29edb78-cc5a-4e48-81af-a915190376af,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29edb78-cc') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd29edb78-cc, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:28 user nova-compute[71516]: INFO os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:90:c1,bridge_name='br-int',has_traffic_filtering=True,id=94d3ede6-25a2-498c-8b67-412a4b84272c,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94d3ede6-25')
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dc3835d-017b-4411-a70a-c538768a13b7", "address": "fa:16:3e:5a:b7:bd", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc3835d-01", "ovs_interfaceid": "0dc3835d-017b-4411-a70a-c538768a13b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "0dc3835d-017b-4411-a70a-c538768a13b7", "address": "fa:16:3e:5a:b7:bd", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc3835d-01", "ovs_interfaceid": "0dc3835d-017b-4411-a70a-c538768a13b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:b7:bd,bridge_name='br-int',has_traffic_filtering=True,id=0dc3835d-017b-4411-a70a-c538768a13b7,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc3835d-01') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:b7:bd,bridge_name='br-int',has_traffic_filtering=True,id=0dc3835d-017b-4411-a70a-c538768a13b7,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc3835d-01') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dc3835d-01, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:28 user nova-compute[71516]: INFO os_vif [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:55:85,bridge_name='br-int',has_traffic_filtering=True,id=d29edb78-cc5a-4e48-81af-a915190376af,network=Network(81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd29edb78-cc')
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIJzmDtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:28 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-dcfc8521-bc5a-4958-81e1-7f6d9153c678 req-d22509a4-62c2-480e-8755-b49baf69bd0e service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-86246915-cf00-43be-b433-01b4ed88252c {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dcfc8521-bc5a-4958-81e1-7f6d9153c678 req-d22509a4-62c2-480e-8755-b49baf69bd0e service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dcfc8521-bc5a-4958-81e1-7f6d9153c678 req-d22509a4-62c2-480e-8755-b49baf69bd0e service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dcfc8521-bc5a-4958-81e1-7f6d9153c678 req-d22509a4-62c2-480e-8755-b49baf69bd0e service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-dcfc8521-bc5a-4958-81e1-7f6d9153c678 req-d22509a4-62c2-480e-8755-b49baf69bd0e service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-86246915-cf00-43be-b433-01b4ed88252c {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: WARNING nova.compute.manager [req-dcfc8521-bc5a-4958-81e1-7f6d9153c678 req-d22509a4-62c2-480e-8755-b49baf69bd0e service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-86246915-cf00-43be-b433-01b4ed88252c for instance with vm_state active and task_state deleting.
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: INFO os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:b7:bd,bridge_name='br-int',has_traffic_filtering=True,id=0dc3835d-017b-4411-a70a-c538768a13b7,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc3835d-01')
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:66:59,bridge_name='br-int',has_traffic_filtering=True,id=ba2be13d-a019-4ba5-8b60-ed888cf7699e,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2be13d-a0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:66:59,bridge_name='br-int',has_traffic_filtering=True,id=ba2be13d-a019-4ba5-8b60-ed888cf7699e,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2be13d-a0') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba2be13d-a0, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13c8248-cdfa-4702-ad68-1a6dbe6f793a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:07:28 user nova-compute[71516]: No targets found.
Apr 11 23:07:28 user nova-compute[71516]: iSNS:
Apr 11 23:07:28 user nova-compute[71516]: No targets found.
Apr 11 23:07:28 user nova-compute[71516]: STATIC:
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: FIRMWARE:
Apr 11 23:07:28 user nova-compute[71516]: No targets found.
Apr 11 23:07:28 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:07:28 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:07:28 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6bf2ad-63d9-4d76-bdcc-ee81cde3b6c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: INFO os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:66:59,bridge_name='br-int',has_traffic_filtering=True,id=ba2be13d-a019-4ba5-8b60-ed888cf7699e,network=Network(67875982-ba72-46aa-9243-7ee6ad548426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2be13d-a0')
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:60:34,bridge_name='br-int',has_traffic_filtering=True,id=7f3e80ab-f7c2-4300-a599-eed29afc0e83,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3e80ab-f7') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:60:34,bridge_name='br-int',has_traffic_filtering=True,id=7f3e80ab-f7c2-4300-a599-eed29afc0e83,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3e80ab-f7') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f3e80ab-f7, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c519ae31-8595-4270-935c-0dbe7c97f9f1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:28 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:28 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5cb9c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc'): ({'sdd'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Removing single pathed devices sdd {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:07:28 user nova-compute[71516]: INFO os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:60:34,bridge_name='br-int',has_traffic_filtering=True,id=7f3e80ab-f7c2-4300-a599-eed29afc0e83,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3e80ab-f7')
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1259538714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1259538714',id=11,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw==',key_name='tempest-keypair-677934585',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4baaf4c6d66541b79d15d024804d934c',ramdisk_id='',reservation_id='r-tgu8ciou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1216653283',owner_user_name='tempest-TaggedBootDevicesTest-1216653283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92d65920f60d4b0e811cf0bd7df65d35',uuid=f59cffaa-b1e0-427d-b395-1043bad9a5c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converting VIF {"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:4c:27,bridge_name='br-int',has_traffic_filtering=True,id=dc64ce92-4113-4d3c-85fd-46ac2058a479,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64ce92-41') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:4c:27,bridge_name='br-int',has_traffic_filtering=True,id=dc64ce92-4113-4d3c-85fd-46ac2058a479,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64ce92-41') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc64ce92-41, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:28 user nova-compute[71516]: INFO os_vif [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:4c:27,bridge_name='br-int',has_traffic_filtering=True,id=dc64ce92-4113-4d3c-85fd-46ac2058a479,network=Network(2fdcac75-feb4-4334-a416-431155705882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64ce92-41')
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQRaYIFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:28 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32a35b6-e518-4673-87e4-c78deb710455]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aea899-4cd8-4b5d-9aa3-f726e3170746]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Flushing IO for device /dev/sdd {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8070f59e-94f1-4a4b-b4d1-ab8ab0f38b98]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGYTRovw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'be9133e2-d785-4ec4-b4a1-843e8def60ba': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:28 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3fe425-4bc1-44fc-8453-f703ffc91005]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa6df4f-8bd2-4907-b947-6e5f4f6df82a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-d29edb78-cc5a-4e48-81af-a915190376af {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-unplugged-d29edb78-cc5a-4e48-81af-a915190376af {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-unplugged-d29edb78-cc5a-4e48-81af-a915190376af for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-plugged-d29edb78-cc5a-4e48-81af-a915190376af {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Acquiring lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] No waiting events found dispatching network-vif-plugged-d29edb78-cc5a-4e48-81af-a915190376af {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: WARNING nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received unexpected event network-vif-plugged-d29edb78-cc5a-4e48-81af-a915190376af for instance with vm_state active and task_state deleting.
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-unplugged-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: WARNING nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-dd4aa184-e61f-4c14-bb1e-04e2b5c139ac for instance with vm_state active and task_state deleting.
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-94d3ede6-25a2-498c-8b67-412a4b84272c {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-unplugged-94d3ede6-25a2-498c-8b67-412a4b84272c {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-94d3ede6-25a2-498c-8b67-412a4b84272c for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-94d3ede6-25a2-498c-8b67-412a4b84272c {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-94d3ede6-25a2-498c-8b67-412a4b84272c {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: WARNING nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-94d3ede6-25a2-498c-8b67-412a4b84272c for instance with vm_state active and task_state deleting.
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-0dc3835d-017b-4411-a70a-c538768a13b7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-unplugged-0dc3835d-017b-4411-a70a-c538768a13b7 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-0dc3835d-017b-4411-a70a-c538768a13b7 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-0dc3835d-017b-4411-a70a-c538768a13b7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-0dc3835d-017b-4411-a70a-c538768a13b7 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: WARNING nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-0dc3835d-017b-4411-a70a-c538768a13b7 for instance with vm_state active and task_state deleting.
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-ba2be13d-a019-4ba5-8b60-ed888cf7699e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-unplugged-ba2be13d-a019-4ba5-8b60-ed888cf7699e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-ba2be13d-a019-4ba5-8b60-ed888cf7699e for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b6dfc7-3b33-469c-85bd-79a40ad8963f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc, portal: 172.16.0.220,3260]
Apr 11 23:07:28 user nova-compute[71516]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:28 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3d8fb7-2270-4c7c-b1ef-63cb207587dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b283de7c-da0e-4325-af94-90f4a1505213]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] <== disconnect_volume: return (428ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.263s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kClvGofd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:28 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b47b0b-3cef-4bb2-9c0c-97adadc5d6f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:07:28 user nova-compute[71516]: No targets found.
Apr 11 23:07:28 user nova-compute[71516]: iSNS:
Apr 11 23:07:28 user nova-compute[71516]: No targets found.
Apr 11 23:07:28 user nova-compute[71516]: STATIC:
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9
Apr 11 23:07:28 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:28 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:28 user nova-compute[71516]: FIRMWARE:
Apr 11 23:07:28 user nova-compute[71516]: No targets found.
Apr 11 23:07:28 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:07:28 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:07:28 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dec8bd-b0ac-4472-8b90-4304b1bb95df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b04474-a812-46fe-95a4-10416602ad74]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:28 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:28 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:28 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e4c7120e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8eb2af-107e-4ec2-8519-5bfbda8bd53d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68feadc-e5bb-48c4-abe6-6e92c84a2531]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1695f292-b981-4111-b021-94f039dd14b3]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e84defe-76a8-4ec7-bb3d-4d9f97879a23]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-7f3e80ab-f7c2-4300-a599-eed29afc0e83 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-unplugged-7f3e80ab-f7c2-4300-a599-eed29afc0e83 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-7f3e80ab-f7c2-4300-a599-eed29afc0e83 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-7f3e80ab-f7c2-4300-a599-eed29afc0e83 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-7f3e80ab-f7c2-4300-a599-eed29afc0e83 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: WARNING nova.compute.manager [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-7f3e80ab-f7c2-4300-a599-eed29afc0e83 for instance with vm_state active and task_state deleting.
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-dc64ce92-4113-4d3c-85fd-46ac2058a479 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-unplugged-dc64ce92-4113-4d3c-85fd-46ac2058a479 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-unplugged-dc64ce92-4113-4d3c-85fd-46ac2058a479 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-dc64ce92-4113-4d3c-85fd-46ac2058a479 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-dc64ce92-4113-4d3c-85fd-46ac2058a479 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:28 user nova-compute[71516]: WARNING nova.compute.manager [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-dc64ce92-4113-4d3c-85fd-46ac2058a479 for instance with vm_state active and task_state deleting.
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c19d7e-f853-418b-9d86-aea21c6a6ce0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[371018e7-e343-4602-a89f-b339b2b4ccf3]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3, portal: 172.16.0.220,3260]
Apr 11 23:07:29 user nova-compute[71516]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0127b28a-b328-4024-8edb-b43c5c24e0b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a533d32-2ed7-4114-b579-3aacf7e20c4b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] <== disconnect_volume: return (688ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.597s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrzWdpGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:29 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[517cc777-7e19-40bd-8bd1-03a91cd587dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:07:29 user nova-compute[71516]: No targets found.
Apr 11 23:07:29 user nova-compute[71516]: iSNS:
Apr 11 23:07:29 user nova-compute[71516]: No targets found.
Apr 11 23:07:29 user nova-compute[71516]: STATIC:
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: FIRMWARE:
Apr 11 23:07:29 user nova-compute[71516]: No targets found.
Apr 11 23:07:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:07:29 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:07:29 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96f1431-f5b0-4827-87fc-a1f2985f40bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[46257bc0-db88-48eb-bfa0-339fa94bcc06]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5fef6cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba'): ({'sdk'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Removing single pathed devices sdk {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d4e96d-c42e-4669-9763-3c598eb253e6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab5b3db-d471-42d8-9889-e5605665214e]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Flushing IO for device /dev/sdk {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b9782f-94c8-4d40-8a58-e9669458f897]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.054s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[10419696-bf89-4b3c-ad03-c837fd0d10dc]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] SCSI volumes sdk have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d46b64-0fc0-438b-8568-d644cf566381]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[93efdb1b-e36f-4c23-bae3-8caafc996637]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba, portal: 172.16.0.220,3260]
Apr 11 23:07:29 user nova-compute[71516]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be9133e2-d785-4ec4-b4a1-843e8def60ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf01a6d-aac9-4bad-bf05-02c86df9c075]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] <== disconnect_volume: return (983ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.819s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a36d12-3a92-4a9a-bc71-e501f1b42d80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:07:29 user nova-compute[71516]: No targets found.
Apr 11 23:07:29 user nova-compute[71516]: iSNS:
Apr 11 23:07:29 user nova-compute[71516]: No targets found.
Apr 11 23:07:29 user nova-compute[71516]: STATIC:
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: FIRMWARE:
Apr 11 23:07:29 user nova-compute[71516]: No targets found.
Apr 11 23:07:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:07:29 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:07:29 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLZoeWMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5d6517f0-c4f0-4b35-a94a-610058ecc687', 'attached_at': '', 'detached_at': '', 'volume_id': '5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 'serial'} {{(pid=71516) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] swap_volume: removing Cinder connection for volume be9133e2-d785-4ec4-b4a1-843e8def60ba {{(pid=71516) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f15599-3f59-4816-b8fa-2ca6ca237abc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[887657a6-642f-4f74-9f40-1bb486106c5c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5fd1da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a'): ({'sdf'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Removing single pathed devices sdf {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9823c79e-0c7b-46c9-9b97-68976cc026e4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[48db45b3-7a4b-4164-a134-70b3c0ef8476]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Flushing IO for device /dev/sdf {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f63e07-7772-47e9-b609-af7f25d806df]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e743216-faba-44d5-b6f7-d323cd2e1c12]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] SCSI volumes sdf have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca36dc1e-9a2c-4084-9f9d-9809110fdb7d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec7b1b5-19de-4b47-8d7d-7a1a4d085cb3]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a, portal: 172.16.0.220,3260]
Apr 11 23:07:29 user nova-compute[71516]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4317ffe-f804-4e63-8a3d-d8b62e7adffa]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] <== disconnect_volume: return (1210ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.746s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jisYQKLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:29 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d379cdc5-0525-4b55-8016-c9e004a22d26]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:07:29 user nova-compute[71516]: No targets found.
Apr 11 23:07:29 user nova-compute[71516]: iSNS:
Apr 11 23:07:29 user nova-compute[71516]: No targets found.
Apr 11 23:07:29 user nova-compute[71516]: STATIC:
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9
Apr 11 23:07:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:29 user nova-compute[71516]: FIRMWARE:
Apr 11 23:07:29 user nova-compute[71516]: No targets found.
Apr 11 23:07:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:07:29 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:07:29 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffea3c70-6ce4-4399-aa77-fe48b895aace]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1debf9-b529-4695-92f5-8069b2917c81]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:29 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5fd1fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9'): ({'sde'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Removing single pathed devices sde {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:07:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] swap_volume: Updating volume be9133e2-d785-4ec4-b4a1-843e8def60ba BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "mLZoeWMa", "auth_password": "5c1MAmpTBSnwd3", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "5041ddaf-d487-479c-a3e7-a06d7bdae1a6"}, "status": "reserved", "instance": "5d6517f0-c4f0-4b35-a94a-610058ecc687", "attached_at": "", "detached_at": "", "volume_id": "5041ddaf-d487-479c-a3e7-a06d7bdae1a6", "serial": "5041ddaf-d487-479c-a3e7-a06d7bdae1a6"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 'no_device': None, 'attachment_id': 'f5a35428-318c-4a09-a7ac-399c0a91fea0'} {{(pid=71516) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0093f572-40f5-4b0a-90b0-c3b9afd5f08f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254435.2329035, 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:07:30 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] VM Stopped (Lifecycle Event)
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:07:30 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=7904MB free_disk=26.42084503173828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.705s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5f9d5a4e-d439-4033-9e53-12f8a2ded047 None None] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69b5403-6473-477d-b4cd-8b7878bbafd0]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Flushing IO for device /dev/sde {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed3abc8-3fb1-48b2-b2e3-aa352fef4d69]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e9c22d-972f-4027-ab8b-5f6045945eff]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba786f0d-93d6-499b-bcd3-fdb8ead04437]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 4f95b120-0c70-45a5-969f-c1728c72d420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 902899b9-8c8f-404e-a110-832b3c91d526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa5e928-a37e-4be7-bb1d-044ab7b3fe72]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9, portal: 172.16.0.220,3260]
Apr 11 23:07:30 user nova-compute[71516]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.manager [req-4391ac96-665f-4e13-bd6b-ab4b4fea448a req-f776c278-3575-4c90-a03a-d6e1e6feb263 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-plugged-ba2be13d-a019-4ba5-8b60-ed888cf7699e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4391ac96-665f-4e13-bd6b-ab4b4fea448a req-f776c278-3575-4c90-a03a-d6e1e6feb263 service nova] Acquiring lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4391ac96-665f-4e13-bd6b-ab4b4fea448a req-f776c278-3575-4c90-a03a-d6e1e6feb263 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4391ac96-665f-4e13-bd6b-ab4b4fea448a req-f776c278-3575-4c90-a03a-d6e1e6feb263 service nova] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.manager [req-4391ac96-665f-4e13-bd6b-ab4b4fea448a req-f776c278-3575-4c90-a03a-d6e1e6feb263 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] No waiting events found dispatching network-vif-plugged-ba2be13d-a019-4ba5-8b60-ed888cf7699e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:30 user nova-compute[71516]: WARNING nova.compute.manager [req-4391ac96-665f-4e13-bd6b-ab4b4fea448a req-f776c278-3575-4c90-a03a-d6e1e6feb263 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received unexpected event network-vif-plugged-ba2be13d-a019-4ba5-8b60-ed888cf7699e for instance with vm_state active and task_state deleting.
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a013301-321d-493d-a359-f3f3806ff591]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.745s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] <== disconnect_volume: return (1491ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.742s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdZOLzAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:30 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8b62f7-f004-478d-90f1-e730a69a80d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:07:30 user nova-compute[71516]: No targets found.
Apr 11 23:07:30 user nova-compute[71516]: iSNS:
Apr 11 23:07:30 user nova-compute[71516]: No targets found.
Apr 11 23:07:30 user nova-compute[71516]: STATIC:
Apr 11 23:07:30 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd
Apr 11 23:07:30 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:30 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:30 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57
Apr 11 23:07:30 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:30 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:30 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6
Apr 11 23:07:30 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:30 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:30 user nova-compute[71516]: FIRMWARE:
Apr 11 23:07:30 user nova-compute[71516]: No targets found.
Apr 11 23:07:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:07:30 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:07:30 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[76415987-b0ae-4ea7-abb5-c6b963b433dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c38817-2123-42fd-8a7c-ec0fa72bf7cc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:30 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:30 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:30 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:30 user nova-compute[71516]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd (non-flash)
Apr 11 23:07:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e4c711b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd'): ({'sdh'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Removing single pathed devices sdh {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b207132-e796-4fff-8a56-5ec5c069de13]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f561dec7-ee40-472d-877c-2e79ee7f69b0]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Flushing IO for device /dev/sdh {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe428a5-915f-46ea-87f3-a4068a13b688]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba523ff-205a-448e-bc14-994d15b59de8]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] SCSI volumes sdh have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c56ddf-6d60-4595-ad41-855754e9475a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[149fce53-93f1-42ed-b93e-0a69c2c4ef16]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd, portal: 172.16.0.220,3260]
Apr 11 23:07:30 user nova-compute[71516]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39261de4-8b4d-4e01-b027-628663c9a7fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3070010-1c30-44f9-acad-1d39c54dc355]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] <== disconnect_volume: return (1045ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:07:30 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Deleting instance files /opt/stack/data/nova/instances/89644573-5fbc-4ab4-a16b-23b7c4f6c598_del
Apr 11 23:07:30 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Deletion of /opt/stack/data/nova/instances/89644573-5fbc-4ab4-a16b-23b7c4f6c598_del complete
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.306s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2e180b-155a-4ce2-a7fe-0ba991fadf66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:07:30 user nova-compute[71516]: No targets found.
Apr 11 23:07:30 user nova-compute[71516]: iSNS:
Apr 11 23:07:30 user nova-compute[71516]: No targets found.
Apr 11 23:07:30 user nova-compute[71516]: STATIC:
Apr 11 23:07:30 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57
Apr 11 23:07:30 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:30 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:30 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6
Apr 11 23:07:30 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:30 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:30 user nova-compute[71516]: FIRMWARE:
Apr 11 23:07:30 user nova-compute[71516]: No targets found.
Apr 11 23:07:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:07:30 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:07:30 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f2e82-9650-4259-b137-afaa0d124ea3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:30 user nova-compute[71516]: INFO nova.compute.manager [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Took 7.07 seconds to destroy the instance on the hypervisor.
Apr 11 23:07:30 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:07:30 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0518f1ff-32f3-41ae-b260-5e29f8f8d361]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:31 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:31 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:31 user nova-compute[71516]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 (non-flash)
Apr 11 23:07:31 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c6dbac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57'): ({'sdg'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Removing single pathed devices sdg {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c45bbd3-b495-42ab-ba6b-d97ae7845c24]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2880941-719a-4a69-841b-fe417e642d4c]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Flushing IO for device /dev/sdg {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[959a07a5-136b-4894-9a5d-786a922847cc]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54f35da-2cff-4ad7-8edd-5640521f595d]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] SCSI volumes sdg have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a29b19-7590-4dfd-80de-4418a9ce3e7e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c53130-6ef6-4060-b55c-38a9e3a0a4eb]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57, portal: 172.16.0.220,3260]
Apr 11 23:07:31 user nova-compute[71516]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:31 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7aa8aa-2f09-46de-80ee-15a1f75cbe57 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d7fbfe-dbf1-412b-9887-16841fb5866f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] <== disconnect_volume: return (598ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:07:31 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Deleting instance files /opt/stack/data/nova/instances/f59cffaa-b1e0-427d-b395-1043bad9a5c7_del
Apr 11 23:07:31 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Deletion of /opt/stack/data/nova/instances/f59cffaa-b1e0-427d-b395-1043bad9a5c7_del complete
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:31 user nova-compute[71516]: INFO nova.compute.manager [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Detaching volume 5041ddaf-d487-479c-a3e7-a06d7bdae1a6
Apr 11 23:07:31 user nova-compute[71516]: INFO nova.compute.manager [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Took 6.08 seconds to destroy the instance on the hypervisor.
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:07:31 user nova-compute[71516]: INFO nova.virt.block_device [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Attempting to driver detach volume 5041ddaf-d487-479c-a3e7-a06d7bdae1a6 from mountpoint /dev/vdb
Apr 11 23:07:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Attempting to detach device vdb from instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:07:31 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:07:31 user nova-compute[71516]:   <source dev="/dev/sdb"/>
Apr 11 23:07:31 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:07:31 user nova-compute[71516]:   <serial>5041ddaf-d487-479c-a3e7-a06d7bdae1a6</serial>
Apr 11 23:07:31 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:07:31 user nova-compute[71516]: </disk>
Apr 11 23:07:31 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:07:31 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Successfully detached device vdb from instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 from the persistent domain config.
Apr 11 23:07:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:07:31 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:07:31 user nova-compute[71516]:   <source dev="/dev/sdb"/>
Apr 11 23:07:31 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:07:31 user nova-compute[71516]:   <serial>5041ddaf-d487-479c-a3e7-a06d7bdae1a6</serial>
Apr 11 23:07:31 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:07:31 user nova-compute[71516]: </disk>
Apr 11 23:07:31 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681254451.7907643, 5d6517f0-c4f0-4b35-a94a-610058ecc687 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:07:31 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Successfully detached device vdb from instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 from the live domain config.
Apr 11 23:07:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLZoeWMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '5041ddaf-d487-479c-a3e7-a06d7bdae1a6': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:07:31 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dfc302-cfc4-4ce1-b064-111e09017552]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:07:31 user nova-compute[71516]: No targets found.
Apr 11 23:07:31 user nova-compute[71516]: iSNS:
Apr 11 23:07:31 user nova-compute[71516]: No targets found.
Apr 11 23:07:31 user nova-compute[71516]: STATIC:
Apr 11 23:07:31 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6
Apr 11 23:07:31 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:07:31 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:07:31 user nova-compute[71516]: FIRMWARE:
Apr 11 23:07:31 user nova-compute[71516]: No targets found.
Apr 11 23:07:31 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:07:31 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:07:31 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[25705ceb-fb58-4351-997e-52f251d981a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[365c2d55-f654-4c22-89b9-af24116fa36f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:31 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 (non-flash)
Apr 11 23:07:31 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5fd4b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6'): ({'sdb'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Removing single pathed devices sdb {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a32862-5c3e-4def-b5ca-6dd95c80a6e1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[944fae1f-ba6e-4a3d-b9c0-40051cf965b3]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Flushing IO for device /dev/sdb {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc4ae1d-924e-4135-8bc6-d38416c66fa4]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5445e45d-99d0-451b-9300-04be6e835790]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:07:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8569bb08-2a05-4cdc-a363-593d49f55fbc]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a334d23-7e33-40fa-97b4-fed72bb9971c]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260]
Apr 11 23:07:32 user nova-compute[71516]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6, portal: 172.16.0.220,3260] successful.
Apr 11 23:07:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5041ddaf-d487-479c-a3e7-a06d7bdae1a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee471b7-9a78-4694-a9d6-4f1040089171]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] <== disconnect_volume: return (298ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG nova.objects.instance [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lazy-loading 'flavor' on Instance uuid 5d6517f0-c4f0-4b35-a94a-610058ecc687 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.673s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:34 user nova-compute[71516]: DEBUG nova.compute.manager [req-3121149e-0ead-4ec7-bdce-e34fda782837 req-66bced37-17da-47bb-b6ff-41a56192e5e1 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-deleted-53ff16a9-5f97-4d83-9b59-7ce5c337f392 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:34 user nova-compute[71516]: INFO nova.compute.manager [req-3121149e-0ead-4ec7-bdce-e34fda782837 req-66bced37-17da-47bb-b6ff-41a56192e5e1 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Neutron deleted interface 53ff16a9-5f97-4d83-9b59-7ce5c337f392; detaching it from the instance and deleting it from the info cache
Apr 11 23:07:34 user nova-compute[71516]: DEBUG nova.network.neutron [req-3121149e-0ead-4ec7-bdce-e34fda782837 req-66bced37-17da-47bb-b6ff-41a56192e5e1 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [{"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5296123e-0b05-4e29-b252-6e2db7395f78", "address": "fa:16:3e:90:c9:63", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296123e-0b", "ovs_interfaceid": "5296123e-0b05-4e29-b252-6e2db7395f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:34 user nova-compute[71516]: DEBUG nova.compute.manager [req-3121149e-0ead-4ec7-bdce-e34fda782837 req-66bced37-17da-47bb-b6ff-41a56192e5e1 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Detach interface failed, port_id=53ff16a9-5f97-4d83-9b59-7ce5c337f392, reason: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:07:34 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254439.2256896, f79fcca6-9f11-498f-b580-5681f9589a77 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:07:34 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] VM Stopped (Lifecycle Event)
Apr 11 23:07:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-35c32473-1193-4099-ad54-81f0718eed03 None None] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:07:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-deleted-5469ebfb-ee6b-49b3-9ae9-35423e6254a1 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:36 user nova-compute[71516]: INFO nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Neutron deleted interface 5469ebfb-ee6b-49b3-9ae9-35423e6254a1; detaching it from the instance and deleting it from the info cache
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating instance_info_cache with network_info: [{"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dc3835d-017b-4411-a70a-c538768a13b7", "address": "fa:16:3e:5a:b7:bd", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc3835d-01", "ovs_interfaceid": "0dc3835d-017b-4411-a70a-c538768a13b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Detach interface failed, port_id=5469ebfb-ee6b-49b3-9ae9-35423e6254a1, reason: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-deleted-5296123e-0b05-4e29-b252-6e2db7395f78 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:36 user nova-compute[71516]: INFO nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Neutron deleted interface 5296123e-0b05-4e29-b252-6e2db7395f78; detaching it from the instance and deleting it from the info cache
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [{"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "86246915-cf00-43be-b433-01b4ed88252c", "address": "fa:16:3e:07:2b:54", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86246915-cf", "ovs_interfaceid": "86246915-cf00-43be-b433-01b4ed88252c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Detach interface failed, port_id=5296123e-0b05-4e29-b252-6e2db7395f78, reason: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-deleted-0dc3835d-017b-4411-a70a-c538768a13b7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:36 user nova-compute[71516]: INFO nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Neutron deleted interface 0dc3835d-017b-4411-a70a-c538768a13b7; detaching it from the instance and deleting it from the info cache
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating instance_info_cache with network_info: [{"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "address": "fa:16:3e:e8:60:34", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3e80ab-f7", "ovs_interfaceid": "7f3e80ab-f7c2-4300-a599-eed29afc0e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Detach interface failed, port_id=0dc3835d-017b-4411-a70a-c538768a13b7, reason: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-deleted-86246915-cf00-43be-b433-01b4ed88252c {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:36 user nova-compute[71516]: INFO nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Neutron deleted interface 86246915-cf00-43be-b433-01b4ed88252c; detaching it from the instance and deleting it from the info cache
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [{"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d29edb78-cc5a-4e48-81af-a915190376af", "address": "fa:16:3e:30:55:85", "network": {"id": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "bridge": "br-int", "label": "tempest-device-tagging-net2-456658049", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd29edb78-cc", "ovs_interfaceid": "d29edb78-cc5a-4e48-81af-a915190376af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Detach interface failed, port_id=86246915-cf00-43be-b433-01b4ed88252c, reason: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-deleted-7f3e80ab-f7c2-4300-a599-eed29afc0e83 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:36 user nova-compute[71516]: INFO nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Neutron deleted interface 7f3e80ab-f7c2-4300-a599-eed29afc0e83; detaching it from the instance and deleting it from the info cache
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating instance_info_cache with network_info: [{"id": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "address": "fa:16:3e:a6:4e:db", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4aa184-e6", "ovs_interfaceid": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94d3ede6-25a2-498c-8b67-412a4b84272c", "address": "fa:16:3e:ab:90:c1", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d3ede6-25", "ovs_interfaceid": "94d3ede6-25a2-498c-8b67-412a4b84272c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "address": "fa:16:3e:61:66:59", "network": {"id": "67875982-ba72-46aa-9243-7ee6ad548426", "bridge": "br-int", "label": "tempest-device-tagging-net1-683986115", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2be13d-a0", "ovs_interfaceid": "ba2be13d-a019-4ba5-8b60-ed888cf7699e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "address": "fa:16:3e:ba:4c:27", "network": {"id": "2fdcac75-feb4-4334-a416-431155705882", "bridge": "br-int", "label": "tempest-device-tagging-net2-795862471", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4baaf4c6d66541b79d15d024804d934c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64ce92-41", "ovs_interfaceid": "dc64ce92-4113-4d3c-85fd-46ac2058a479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Detach interface failed, port_id=7f3e80ab-f7c2-4300-a599-eed29afc0e83, reason: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-deleted-d29edb78-cc5a-4e48-81af-a915190376af {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:36 user nova-compute[71516]: INFO nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Neutron deleted interface d29edb78-cc5a-4e48-81af-a915190376af; detaching it from the instance and deleting it from the info cache
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [{"id": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "address": "fa:16:3e:a2:64:78", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9486eb92-5c", "ovs_interfaceid": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f2220da-1007-4ae8-9c12-73a142b02b49", "address": "fa:16:3e:65:fb:35", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2220da-10", "ovs_interfaceid": "4f2220da-1007-4ae8-9c12-73a142b02b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "address": "fa:16:3e:68:a5:c1", "network": {"id": "a781604b-df59-4e97-af90-76111c0cda1e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2052429389", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2ea0b8c8a4b4a1cac18e97464975fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a39a5d-8b", "ovs_interfaceid": "39a39a5d-8b30-4e73-893d-323dbde1de9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Detach interface failed, port_id=d29edb78-cc5a-4e48-81af-a915190376af, reason: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:36 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Took 5.66 seconds to deallocate network for instance.
Apr 11 23:07:36 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:36 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Took 5.59 seconds to deallocate network for instance.
Apr 11 23:07:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-452b405f-6196-4c6b-9679-7c8a37566204 req-2b8c99b7-885a-49a5-9153-339e52537d69 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-deleted-ba2be13d-a019-4ba5-8b60-ed888cf7699e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-452b405f-6196-4c6b-9679-7c8a37566204 req-2b8c99b7-885a-49a5-9153-339e52537d69 service nova] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Received event network-vif-deleted-39a39a5d-8b30-4e73-893d-323dbde1de9f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-452b405f-6196-4c6b-9679-7c8a37566204 req-2b8c99b7-885a-49a5-9153-339e52537d69 service nova] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Received event network-vif-deleted-dc64ce92-4113-4d3c-85fd-46ac2058a479 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:38 user nova-compute[71516]: INFO nova.compute.manager [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Took 2.19 seconds to detach 3 volumes for instance.
Apr 11 23:07:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:39 user nova-compute[71516]: INFO nova.compute.manager [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Took 2.24 seconds to detach 3 volumes for instance.
Apr 11 23:07:39 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:07:39 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:07:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.018s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:39 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Deleted allocations for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598
Apr 11 23:07:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "89644573-5fbc-4ab4-a16b-23b7c4f6c598" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.421s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:39 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:07:39 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:07:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:39 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Deleted allocations for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7
Apr 11 23:07:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "f59cffaa-b1e0-427d-b395-1043bad9a5c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.511s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:41 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254446.1705534, 89644573-5fbc-4ab4-a16b-23b7c4f6c598 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:07:41 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] VM Stopped (Lifecycle Event)
Apr 11 23:07:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-93470952-485c-4676-8515-fc3263239de9 None None] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:07:42 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254447.3688884, f59cffaa-b1e0-427d-b395-1043bad9a5c7 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:07:42 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] VM Stopped (Lifecycle Event)
Apr 11 23:07:42 user nova-compute[71516]: DEBUG nova.compute.manager [None req-00deadd3-519b-4f04-8f98-a02b4573c552 None None] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:07:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:07:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:07:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:07:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "04b926fc-370b-485a-ad51-944ba0791ebb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "04b926fc-370b-485a-ad51-944ba0791ebb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:54 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:07:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:07:54 user nova-compute[71516]: INFO nova.compute.claims [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Claim successful on node user
Apr 11 23:07:55 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG nova.network.neutron [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:07:55 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:07:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG nova.policy [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '340848f1de07428e85af2cf660943c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d77b00c084f6f857147717350b6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:07:55 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Creating image(s)
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "/opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "/opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "/opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk 1073741824" returned: 0 in 0.051s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.130s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:07:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Cannot resize image /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG nova.objects.instance [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lazy-loading 'migration_context' on Instance uuid 04b926fc-370b-485a-ad51-944ba0791ebb {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Ensure instance console log exists: /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG nova.network.neutron [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Successfully created port: dc4b3a29-90e2-4b93-838d-a01ef7479bfb {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG nova.network.neutron [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Successfully updated port: dc4b3a29-90e2-4b93-838d-a01ef7479bfb {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "refresh_cache-04b926fc-370b-485a-ad51-944ba0791ebb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquired lock "refresh_cache-04b926fc-370b-485a-ad51-944ba0791ebb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG nova.network.neutron [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Received event network-changed-dc4b3a29-90e2-4b93-838d-a01ef7479bfb {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Refreshing instance network info cache due to event network-changed-dc4b3a29-90e2-4b93-838d-a01ef7479bfb. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] Acquiring lock "refresh_cache-04b926fc-370b-485a-ad51-944ba0791ebb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:07:56 user nova-compute[71516]: DEBUG nova.network.neutron [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.network.neutron [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Updating instance_info_cache with network_info: [{"id": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "address": "fa:16:3e:25:9b:bc", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4b3a29-90", "ovs_interfaceid": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Releasing lock "refresh_cache-04b926fc-370b-485a-ad51-944ba0791ebb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Instance network_info: |[{"id": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "address": "fa:16:3e:25:9b:bc", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4b3a29-90", "ovs_interfaceid": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] Acquired lock "refresh_cache-04b926fc-370b-485a-ad51-944ba0791ebb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.network.neutron [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Refreshing network info cache for port dc4b3a29-90e2-4b93-838d-a01ef7479bfb {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Start _get_guest_xml network_info=[{"id": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "address": "fa:16:3e:25:9b:bc", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4b3a29-90", "ovs_interfaceid": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:07:57 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:07:57 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:07:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-377335540',display_name='tempest-VolumesAdminNegativeTest-server-377335540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-377335540',id=13,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c24d77b00c084f6f857147717350b6e0',ramdisk_id='',reservation_id='r-dgnj21lw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-497834960',owner_user_name='tempest-VolumesAdminNegativeTest-497834960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:07:55Z,user_data=None,user_id='340848f1de07428e85af2cf660943c3e',uuid=04b926fc-370b-485a-ad51-944ba0791ebb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "address": "fa:16:3e:25:9b:bc", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4b3a29-90", "ovs_interfaceid": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Converting VIF {"id": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "address": "fa:16:3e:25:9b:bc", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4b3a29-90", "ovs_interfaceid": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=dc4b3a29-90e2-4b93-838d-a01ef7479bfb,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4b3a29-90') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.objects.instance [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lazy-loading 'pci_devices' on Instance uuid 04b926fc-370b-485a-ad51-944ba0791ebb {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:07:57 user nova-compute[71516]:   <uuid>04b926fc-370b-485a-ad51-944ba0791ebb</uuid>
Apr 11 23:07:57 user nova-compute[71516]:   <name>instance-0000000d</name>
Apr 11 23:07:57 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:07:57 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:07:57 user nova-compute[71516]:   <metadata>
Apr 11 23:07:57 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:07:57 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:07:57 user nova-compute[71516]:       <nova:name>tempest-VolumesAdminNegativeTest-server-377335540</nova:name>
Apr 11 23:07:57 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:07:57</nova:creationTime>
Apr 11 23:07:57 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:07:57 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:07:57 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:07:57 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:07:57 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:07:57 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:07:57 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:07:57 user nova-compute[71516]:       <nova:owner>
Apr 11 23:07:57 user nova-compute[71516]:         <nova:user uuid="340848f1de07428e85af2cf660943c3e">tempest-VolumesAdminNegativeTest-497834960-project-member</nova:user>
Apr 11 23:07:57 user nova-compute[71516]:         <nova:project uuid="c24d77b00c084f6f857147717350b6e0">tempest-VolumesAdminNegativeTest-497834960</nova:project>
Apr 11 23:07:57 user nova-compute[71516]:       </nova:owner>
Apr 11 23:07:57 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:07:57 user nova-compute[71516]:       <nova:ports>
Apr 11 23:07:57 user nova-compute[71516]:         <nova:port uuid="dc4b3a29-90e2-4b93-838d-a01ef7479bfb">
Apr 11 23:07:57 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 23:07:57 user nova-compute[71516]:         </nova:port>
Apr 11 23:07:57 user nova-compute[71516]:       </nova:ports>
Apr 11 23:07:57 user nova-compute[71516]:     </nova:instance>
Apr 11 23:07:57 user nova-compute[71516]:   </metadata>
Apr 11 23:07:57 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:07:57 user nova-compute[71516]:     <system>
Apr 11 23:07:57 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:07:57 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:07:57 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:07:57 user nova-compute[71516]:       <entry name="serial">04b926fc-370b-485a-ad51-944ba0791ebb</entry>
Apr 11 23:07:57 user nova-compute[71516]:       <entry name="uuid">04b926fc-370b-485a-ad51-944ba0791ebb</entry>
Apr 11 23:07:57 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:07:57 user nova-compute[71516]:     </system>
Apr 11 23:07:57 user nova-compute[71516]:   </sysinfo>
Apr 11 23:07:57 user nova-compute[71516]:   <os>
Apr 11 23:07:57 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:07:57 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:07:57 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:07:57 user nova-compute[71516]:   </os>
Apr 11 23:07:57 user nova-compute[71516]:   <features>
Apr 11 23:07:57 user nova-compute[71516]:     <acpi/>
Apr 11 23:07:57 user nova-compute[71516]:     <apic/>
Apr 11 23:07:57 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:07:57 user nova-compute[71516]:   </features>
Apr 11 23:07:57 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:07:57 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:07:57 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:07:57 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:07:57 user nova-compute[71516]:   </clock>
Apr 11 23:07:57 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:07:57 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:07:57 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:07:57 user nova-compute[71516]:   </cpu>
Apr 11 23:07:57 user nova-compute[71516]:   <devices>
Apr 11 23:07:57 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:07:57 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:07:57 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk"/>
Apr 11 23:07:57 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:07:57 user nova-compute[71516]:     </disk>
Apr 11 23:07:57 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:07:57 user nova-compute[71516]:       <mac address="fa:16:3e:25:9b:bc"/>
Apr 11 23:07:57 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:07:57 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:07:57 user nova-compute[71516]:       <target dev="tapdc4b3a29-90"/>
Apr 11 23:07:57 user nova-compute[71516]:     </interface>
Apr 11 23:07:57 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:07:57 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/console.log" append="off"/>
Apr 11 23:07:57 user nova-compute[71516]:     </serial>
Apr 11 23:07:57 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:07:57 user nova-compute[71516]:     <video>
Apr 11 23:07:57 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:07:57 user nova-compute[71516]:     </video>
Apr 11 23:07:57 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:07:57 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:07:57 user nova-compute[71516]:     </rng>
Apr 11 23:07:57 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:07:57 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:07:57 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:07:57 user nova-compute[71516]:     </memballoon>
Apr 11 23:07:57 user nova-compute[71516]:   </devices>
Apr 11 23:07:57 user nova-compute[71516]: </domain>
Apr 11 23:07:57 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:07:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-377335540',display_name='tempest-VolumesAdminNegativeTest-server-377335540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-377335540',id=13,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c24d77b00c084f6f857147717350b6e0',ramdisk_id='',reservation_id='r-dgnj21lw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-497834960',owner_user_name='tempest-VolumesAdminNegativeTest-497834960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:07:55Z,user_data=None,user_id='340848f1de07428e85af2cf660943c3e',uuid=04b926fc-370b-485a-ad51-944ba0791ebb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "address": "fa:16:3e:25:9b:bc", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4b3a29-90", "ovs_interfaceid": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Converting VIF {"id": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "address": "fa:16:3e:25:9b:bc", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4b3a29-90", "ovs_interfaceid": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=dc4b3a29-90e2-4b93-838d-a01ef7479bfb,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4b3a29-90') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG os_vif [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=dc4b3a29-90e2-4b93-838d-a01ef7479bfb,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4b3a29-90') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc4b3a29-90, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc4b3a29-90, col_values=(('external_ids', {'iface-id': 'dc4b3a29-90e2-4b93-838d-a01ef7479bfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:9b:bc', 'vm-uuid': '04b926fc-370b-485a-ad51-944ba0791ebb'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:57 user nova-compute[71516]: INFO os_vif [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=dc4b3a29-90e2-4b93-838d-a01ef7479bfb,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4b3a29-90')
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] No VIF found with MAC fa:16:3e:25:9b:bc, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.network.neutron [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Updated VIF entry in instance network info cache for port dc4b3a29-90e2-4b93-838d-a01ef7479bfb. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG nova.network.neutron [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Updating instance_info_cache with network_info: [{"id": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "address": "fa:16:3e:25:9b:bc", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4b3a29-90", "ovs_interfaceid": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:07:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] Releasing lock "refresh_cache-04b926fc-370b-485a-ad51-944ba0791ebb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:07:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:07:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed0fc825-e28e-448c-be12-660f8897ff89 req-8889676a-6bac-4d18-aaf1-2d19b758be2b service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Received event network-vif-plugged-dc4b3a29-90e2-4b93-838d-a01ef7479bfb {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:07:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed0fc825-e28e-448c-be12-660f8897ff89 req-8889676a-6bac-4d18-aaf1-2d19b758be2b service nova] Acquiring lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:07:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed0fc825-e28e-448c-be12-660f8897ff89 req-8889676a-6bac-4d18-aaf1-2d19b758be2b service nova] Lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:07:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed0fc825-e28e-448c-be12-660f8897ff89 req-8889676a-6bac-4d18-aaf1-2d19b758be2b service nova] Lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:07:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed0fc825-e28e-448c-be12-660f8897ff89 req-8889676a-6bac-4d18-aaf1-2d19b758be2b service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] No waiting events found dispatching network-vif-plugged-dc4b3a29-90e2-4b93-838d-a01ef7479bfb {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:07:58 user nova-compute[71516]: WARNING nova.compute.manager [req-ed0fc825-e28e-448c-be12-660f8897ff89 req-8889676a-6bac-4d18-aaf1-2d19b758be2b service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Received unexpected event network-vif-plugged-dc4b3a29-90e2-4b93-838d-a01ef7479bfb for instance with vm_state building and task_state spawning.
Apr 11 23:08:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254480.6897192, 04b926fc-370b-485a-ad51-944ba0791ebb => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:08:00 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] VM Resumed (Lifecycle Event)
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:08:00 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Instance spawned successfully.
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:00 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254480.690994, 04b926fc-370b-485a-ad51-944ba0791ebb => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:08:00 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] VM Started (Lifecycle Event)
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:08:00 user nova-compute[71516]: INFO nova.compute.manager [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Took 5.34 seconds to spawn the instance on the hypervisor.
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:00 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:08:00 user nova-compute[71516]: INFO nova.compute.manager [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Took 5.97 seconds to build instance.
Apr 11 23:08:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "04b926fc-370b-485a-ad51-944ba0791ebb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.067s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-2eed6297-c661-4f0f-be1a-0939becfa400 req-7c401ef1-6bab-4a50-bc87-f36054889c0d service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Received event network-vif-plugged-dc4b3a29-90e2-4b93-838d-a01ef7479bfb {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2eed6297-c661-4f0f-be1a-0939becfa400 req-7c401ef1-6bab-4a50-bc87-f36054889c0d service nova] Acquiring lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2eed6297-c661-4f0f-be1a-0939becfa400 req-7c401ef1-6bab-4a50-bc87-f36054889c0d service nova] Lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2eed6297-c661-4f0f-be1a-0939becfa400 req-7c401ef1-6bab-4a50-bc87-f36054889c0d service nova] Lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-2eed6297-c661-4f0f-be1a-0939becfa400 req-7c401ef1-6bab-4a50-bc87-f36054889c0d service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] No waiting events found dispatching network-vif-plugged-dc4b3a29-90e2-4b93-838d-a01ef7479bfb {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:00 user nova-compute[71516]: WARNING nova.compute.manager [req-2eed6297-c661-4f0f-be1a-0939becfa400 req-7c401ef1-6bab-4a50-bc87-f36054889c0d service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Received unexpected event network-vif-plugged-dc4b3a29-90e2-4b93-838d-a01ef7479bfb for instance with vm_state active and task_state None.
Apr 11 23:08:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:08:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "902899b9-8c8f-404e-a110-832b3c91d526" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:09 user nova-compute[71516]: INFO nova.compute.manager [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Terminating instance
Apr 11 23:08:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-a7e340b1-04aa-4431-a904-afb4cb5cacdd req-c88849dd-ce0d-4469-9099-62b18ab56ef6 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-vif-unplugged-ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a7e340b1-04aa-4431-a904-afb4cb5cacdd req-c88849dd-ce0d-4469-9099-62b18ab56ef6 service nova] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a7e340b1-04aa-4431-a904-afb4cb5cacdd req-c88849dd-ce0d-4469-9099-62b18ab56ef6 service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a7e340b1-04aa-4431-a904-afb4cb5cacdd req-c88849dd-ce0d-4469-9099-62b18ab56ef6 service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-a7e340b1-04aa-4431-a904-afb4cb5cacdd req-c88849dd-ce0d-4469-9099-62b18ab56ef6 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] No waiting events found dispatching network-vif-unplugged-ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-a7e340b1-04aa-4431-a904-afb4cb5cacdd req-c88849dd-ce0d-4469-9099-62b18ab56ef6 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-vif-unplugged-ce46605b-463c-483c-9887-8923c6b74bbd for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:08:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Instance destroyed successfully.
Apr 11 23:08:10 user nova-compute[71516]: DEBUG nova.objects.instance [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lazy-loading 'resources' on Instance uuid 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T23:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1742434033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1742434033',id=8,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjYyFfjZ4jJzoYCxHNitzizXcyb+46lxif+p1WR3AxkPOuuDeeRO58EcoDOCV1AotgbxMzrZn7KKNU1EvmEh6aGyzyrtnw/YgTuT0xmESOl+oFG8zQeViLhG0BqUIwvWg==',key_name='tempest-keypair-1602402085',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35fb372296e5430e9f915be720934494',ramdisk_id='',reservation_id='r-4b344c26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2113709125',owner_user_name='tempest-TaggedAttachmentsTest-2113709125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343064f07762476ca5221be36dcbd0de',uuid=902899b9-8c8f-404e-a110-832b3c91d526,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:08:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converting VIF {"id": "ce46605b-463c-483c-9887-8923c6b74bbd", "address": "fa:16:3e:da:ae:a2", "network": {"id": "ec308915-bf10-473b-ae96-e2933989bb95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1026747569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fb372296e5430e9f915be720934494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce46605b-46", "ovs_interfaceid": "ce46605b-463c-483c-9887-8923c6b74bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:ae:a2,bridge_name='br-int',has_traffic_filtering=True,id=ce46605b-463c-483c-9887-8923c6b74bbd,network=Network(ec308915-bf10-473b-ae96-e2933989bb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce46605b-46') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:10 user nova-compute[71516]: DEBUG os_vif [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:ae:a2,bridge_name='br-int',has_traffic_filtering=True,id=ce46605b-463c-483c-9887-8923c6b74bbd,network=Network(ec308915-bf10-473b-ae96-e2933989bb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce46605b-46') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:08:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce46605b-46, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:08:10 user nova-compute[71516]: INFO os_vif [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:ae:a2,bridge_name='br-int',has_traffic_filtering=True,id=ce46605b-463c-483c-9887-8923c6b74bbd,network=Network(ec308915-bf10-473b-ae96-e2933989bb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce46605b-46')
Apr 11 23:08:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Deleting instance files /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526_del
Apr 11 23:08:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Deletion of /opt/stack/data/nova/instances/902899b9-8c8f-404e-a110-832b3c91d526_del complete
Apr 11 23:08:10 user nova-compute[71516]: INFO nova.compute.manager [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 11 23:08:10 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:08:10 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:08:10 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:08:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:11 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:08:11 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Took 0.86 seconds to deallocate network for instance.
Apr 11 23:08:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:11 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:08:11 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:08:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:11 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Deleted allocations for instance 902899b9-8c8f-404e-a110-832b3c91d526
Apr 11 23:08:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "902899b9-8c8f-404e-a110-832b3c91d526" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.217s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-vif-plugged-ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] Acquiring lock "902899b9-8c8f-404e-a110-832b3c91d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] Lock "902899b9-8c8f-404e-a110-832b3c91d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] No waiting events found dispatching network-vif-plugged-ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:11 user nova-compute[71516]: WARNING nova.compute.manager [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received unexpected event network-vif-plugged-ce46605b-463c-483c-9887-8923c6b74bbd for instance with vm_state deleted and task_state None.
Apr 11 23:08:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Received event network-vif-deleted-ce46605b-463c-483c-9887-8923c6b74bbd {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:08:15 user nova-compute[71516]: INFO nova.compute.claims [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Claim successful on node user
Apr 11 23:08:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:08:15 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:08:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:08:15 user nova-compute[71516]: INFO nova.virt.block_device [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Booting with volume 1f79365f-d1d4-4c01-94f3-205e20bec9d5 at /dev/vda
Apr 11 23:08:15 user nova-compute[71516]: DEBUG os_brick.utils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d8e1a7-d190-45dd-8e2f-17a10091cd2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG nova.policy [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac003c68-9ff1-44f3-8a60-ca1763c369a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e8ee19-a85a-41bd-a0db-6f3a5564e5d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac0f3be-d4cd-42e4-83d0-4ad3e178fec4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:08:15 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:08:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1064c6c4-2e68-49e6-9fbd-ddcbe098489c]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG os_brick.utils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:08:15 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Updating existing volume attachment record: 905f3d5c-28e6-402c-8c7b-f43fad50364e {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:08:16 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Successfully created port: 138c5b33-78b0-4ca8-a952-7be3e230441b {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:08:18 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Successfully updated port: 138c5b33-78b0-4ca8-a952-7be3e230441b {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:08:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "refresh_cache-2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:08:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquired lock "refresh_cache-2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:08:18 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:08:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Received event network-changed-138c5b33-78b0-4ca8-a952-7be3e230441b {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Refreshing instance network info cache due to event network-changed-138c5b33-78b0-4ca8-a952-7be3e230441b. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:08:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] Acquiring lock "refresh_cache-2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:08:18 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:08:18 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Updating instance_info_cache with network_info: [{"id": "138c5b33-78b0-4ca8-a952-7be3e230441b", "address": "fa:16:3e:b4:8e:33", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138c5b33-78", "ovs_interfaceid": "138c5b33-78b0-4ca8-a952-7be3e230441b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:08:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Releasing lock "refresh_cache-2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:08:18 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Instance network_info: |[{"id": "138c5b33-78b0-4ca8-a952-7be3e230441b", "address": "fa:16:3e:b4:8e:33", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138c5b33-78", "ovs_interfaceid": "138c5b33-78b0-4ca8-a952-7be3e230441b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:08:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] Acquired lock "refresh_cache-2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:08:18 user nova-compute[71516]: DEBUG nova.network.neutron [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Refreshing network info cache for port 138c5b33-78b0-4ca8-a952-7be3e230441b {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:08:19 user nova-compute[71516]: DEBUG nova.network.neutron [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Updated VIF entry in instance network info cache for port 138c5b33-78b0-4ca8-a952-7be3e230441b. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:08:19 user nova-compute[71516]: DEBUG nova.network.neutron [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Updating instance_info_cache with network_info: [{"id": "138c5b33-78b0-4ca8-a952-7be3e230441b", "address": "fa:16:3e:b4:8e:33", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138c5b33-78", "ovs_interfaceid": "138c5b33-78b0-4ca8-a952-7be3e230441b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:08:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] Releasing lock "refresh_cache-2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:08:20 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Creating image(s)
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Ensure instance console log exists: /opt/stack/data/nova/instances/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Start _get_guest_xml network_info=[{"id": "138c5b33-78b0-4ca8-a952-7be3e230441b", "address": "fa:16:3e:b4:8e:33", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138c5b33-78", "ovs_interfaceid": "138c5b33-78b0-4ca8-a952-7be3e230441b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECkHzdLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2bd67ca7-90b7-4881-9fb1-a1a23cc424fe', 'attached_at': '', 'detached_at': '', 'volume_id': '1f79365f-d1d4-4c01-94f3-205e20bec9d5', 'serial': '1f79365f-d1d4-4c01-94f3-205e20bec9d5'}, 'disk_bus': 'virtio', 'attachment_id': '905f3d5c-28e6-402c-8c7b-f43fad50364e', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:08:20 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:08:20 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECkHzdLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:08:20 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:20 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:20 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1db6cb7-f6cb-4cfc-9449-856860638b69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:08:20 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2620c535-6471-41c0-b88f-bc009a6872bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5] added
Apr 11 23:08:20 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bb540a-a294-41f1-80d8-dfdf5a1200d7]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[66642b81-472a-44e3-a0ac-0e8429268db0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECkHzdLR {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECkHzdLR" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93813b0-8f3b-4b6e-8e62-082fa739cb04]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ECkHzdLR'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8c5070-d5e8-4ebe-b3c4-69bcbcb56825]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6693bf-6a06-4279-bcc5-ea9cfde38be7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 23:08:20 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 23:08:20 user nova-compute[71516]:  {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:08:20 user nova-compute[71516]: WARNING os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 23:08:20 user nova-compute[71516]: 
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e465a2b-4c3d-4b69-8e55-897b10d46171]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5, portal: 172.16.0.220,3260]
Apr 11 23:08:20 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5, portal: 172.16.0.220,3260] successful.
Apr 11 23:08:20 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f18458-bf53-4044-b092-2fef3067e520]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2f073e-eecd-4665-9cf9-3071bf7e9f09]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:20 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:20 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bec9442-a431-494b-9a37-cac1ad3070a6]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:08:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECkHzdLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:21 user nova-compute[71516]: INFO nova.compute.manager [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Terminating instance
Apr 11 23:08:21 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-610bb6e8-31a5-4dec-9255-b8d580efaebb req-7dfbe180-5962-4bfc-a67d-9ebb881d8fff service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Received event network-vif-unplugged-37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-610bb6e8-31a5-4dec-9255-b8d580efaebb req-7dfbe180-5962-4bfc-a67d-9ebb881d8fff service nova] Acquiring lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-610bb6e8-31a5-4dec-9255-b8d580efaebb req-7dfbe180-5962-4bfc-a67d-9ebb881d8fff service nova] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-610bb6e8-31a5-4dec-9255-b8d580efaebb req-7dfbe180-5962-4bfc-a67d-9ebb881d8fff service nova] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-610bb6e8-31a5-4dec-9255-b8d580efaebb req-7dfbe180-5962-4bfc-a67d-9ebb881d8fff service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] No waiting events found dispatching network-vif-unplugged-37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-610bb6e8-31a5-4dec-9255-b8d580efaebb req-7dfbe180-5962-4bfc-a67d-9ebb881d8fff service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Received event network-vif-unplugged-37163c3c-1128-4143-af68-134f3f922fa2 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23538323433333464', 'path': '/dev/sdb'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538323433333464', 'path': '/dev/sdb'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-205162088',display_name='tempest-TestVolumeBootPattern-volume-backed-server-205162088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-205162088',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-4vk1ldh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:08:16Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=2bd67ca7-90b7-4881-9fb1-a1a23cc424fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "138c5b33-78b0-4ca8-a952-7be3e230441b", "address": "fa:16:3e:b4:8e:33", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138c5b33-78", "ovs_interfaceid": "138c5b33-78b0-4ca8-a952-7be3e230441b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:08:21 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "138c5b33-78b0-4ca8-a952-7be3e230441b", "address": "fa:16:3e:b4:8e:33", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138c5b33-78", "ovs_interfaceid": "138c5b33-78b0-4ca8-a952-7be3e230441b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:8e:33,bridge_name='br-int',has_traffic_filtering=True,id=138c5b33-78b0-4ca8-a952-7be3e230441b,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138c5b33-78') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:08:22 user nova-compute[71516]:   <uuid>2bd67ca7-90b7-4881-9fb1-a1a23cc424fe</uuid>
Apr 11 23:08:22 user nova-compute[71516]:   <name>instance-0000000e</name>
Apr 11 23:08:22 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:08:22 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:08:22 user nova-compute[71516]:   <metadata>
Apr 11 23:08:22 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:08:22 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:08:22 user nova-compute[71516]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-205162088</nova:name>
Apr 11 23:08:22 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:08:20</nova:creationTime>
Apr 11 23:08:22 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:08:22 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:08:22 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:08:22 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:08:22 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:08:22 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:08:22 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:08:22 user nova-compute[71516]:       <nova:owner>
Apr 11 23:08:22 user nova-compute[71516]:         <nova:user uuid="589c07cd12e849cfa38423959e76c695">tempest-TestVolumeBootPattern-365588456-project-member</nova:user>
Apr 11 23:08:22 user nova-compute[71516]:         <nova:project uuid="f6700d66136e4f9590658e3103cceac8">tempest-TestVolumeBootPattern-365588456</nova:project>
Apr 11 23:08:22 user nova-compute[71516]:       </nova:owner>
Apr 11 23:08:22 user nova-compute[71516]:       <nova:ports>
Apr 11 23:08:22 user nova-compute[71516]:         <nova:port uuid="138c5b33-78b0-4ca8-a952-7be3e230441b">
Apr 11 23:08:22 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 23:08:22 user nova-compute[71516]:         </nova:port>
Apr 11 23:08:22 user nova-compute[71516]:       </nova:ports>
Apr 11 23:08:22 user nova-compute[71516]:     </nova:instance>
Apr 11 23:08:22 user nova-compute[71516]:   </metadata>
Apr 11 23:08:22 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:08:22 user nova-compute[71516]:     <system>
Apr 11 23:08:22 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:08:22 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:08:22 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:08:22 user nova-compute[71516]:       <entry name="serial">2bd67ca7-90b7-4881-9fb1-a1a23cc424fe</entry>
Apr 11 23:08:22 user nova-compute[71516]:       <entry name="uuid">2bd67ca7-90b7-4881-9fb1-a1a23cc424fe</entry>
Apr 11 23:08:22 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:08:22 user nova-compute[71516]:     </system>
Apr 11 23:08:22 user nova-compute[71516]:   </sysinfo>
Apr 11 23:08:22 user nova-compute[71516]:   <os>
Apr 11 23:08:22 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:08:22 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:08:22 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:08:22 user nova-compute[71516]:   </os>
Apr 11 23:08:22 user nova-compute[71516]:   <features>
Apr 11 23:08:22 user nova-compute[71516]:     <acpi/>
Apr 11 23:08:22 user nova-compute[71516]:     <apic/>
Apr 11 23:08:22 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:08:22 user nova-compute[71516]:   </features>
Apr 11 23:08:22 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:08:22 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:08:22 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:08:22 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:08:22 user nova-compute[71516]:   </clock>
Apr 11 23:08:22 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:08:22 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:08:22 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:08:22 user nova-compute[71516]:   </cpu>
Apr 11 23:08:22 user nova-compute[71516]:   <devices>
Apr 11 23:08:22 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:08:22 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:08:22 user nova-compute[71516]:       <source dev="/dev/sdb"/>
Apr 11 23:08:22 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:08:22 user nova-compute[71516]:       <serial>1f79365f-d1d4-4c01-94f3-205e20bec9d5</serial>
Apr 11 23:08:22 user nova-compute[71516]:     </disk>
Apr 11 23:08:22 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:08:22 user nova-compute[71516]:       <mac address="fa:16:3e:b4:8e:33"/>
Apr 11 23:08:22 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:08:22 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:08:22 user nova-compute[71516]:       <target dev="tap138c5b33-78"/>
Apr 11 23:08:22 user nova-compute[71516]:     </interface>
Apr 11 23:08:22 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:08:22 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe/console.log" append="off"/>
Apr 11 23:08:22 user nova-compute[71516]:     </serial>
Apr 11 23:08:22 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:08:22 user nova-compute[71516]:     <video>
Apr 11 23:08:22 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:08:22 user nova-compute[71516]:     </video>
Apr 11 23:08:22 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:08:22 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:08:22 user nova-compute[71516]:     </rng>
Apr 11 23:08:22 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:08:22 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:08:22 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:08:22 user nova-compute[71516]:     </memballoon>
Apr 11 23:08:22 user nova-compute[71516]:   </devices>
Apr 11 23:08:22 user nova-compute[71516]: </domain>
Apr 11 23:08:22 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-205162088',display_name='tempest-TestVolumeBootPattern-volume-backed-server-205162088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-205162088',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-4vk1ldh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:08:16Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=2bd67ca7-90b7-4881-9fb1-a1a23cc424fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "138c5b33-78b0-4ca8-a952-7be3e230441b", "address": "fa:16:3e:b4:8e:33", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138c5b33-78", "ovs_interfaceid": "138c5b33-78b0-4ca8-a952-7be3e230441b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "138c5b33-78b0-4ca8-a952-7be3e230441b", "address": "fa:16:3e:b4:8e:33", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138c5b33-78", "ovs_interfaceid": "138c5b33-78b0-4ca8-a952-7be3e230441b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:8e:33,bridge_name='br-int',has_traffic_filtering=True,id=138c5b33-78b0-4ca8-a952-7be3e230441b,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138c5b33-78') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG os_vif [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:8e:33,bridge_name='br-int',has_traffic_filtering=True,id=138c5b33-78b0-4ca8-a952-7be3e230441b,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138c5b33-78') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap138c5b33-78, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap138c5b33-78, col_values=(('external_ids', {'iface-id': '138c5b33-78b0-4ca8-a952-7be3e230441b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:8e:33', 'vm-uuid': '2bd67ca7-90b7-4881-9fb1-a1a23cc424fe'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:22 user nova-compute[71516]: INFO os_vif [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:8e:33,bridge_name='br-int',has_traffic_filtering=True,id=138c5b33-78b0-4ca8-a952-7be3e230441b,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138c5b33-78')
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] No VIF found with MAC fa:16:3e:b4:8e:33, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:08:22 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Instance destroyed successfully.
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.objects.instance [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lazy-loading 'resources' on Instance uuid 5d6517f0-c4f0-4b35-a94a-610058ecc687 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2088061217',display_name='tempest-TestVolumeSwap-server-2088061217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2088061217',id=6,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcZSeQR7Wc+y8f0fYbTRcs8v3/VAfwZDXS0iV+9qSnNNj/GWc2eCD17bn79lZa3dYdLohcJtJ6JWgwR4YOz3w8nCzMZ9rJ5FuVmKT8eNb0z8wtI31+Z8kDZzhe6ZPQtuQ==',key_name='tempest-keypair-1498862326',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='204fa09429ce4f2fafbc532805a346bc',ramdisk_id='',reservation_id='r-xq3mt1nf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1115138571',owner_user_name='tempest-TestVolumeSwap-1115138571-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:05:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9554290c1a944393b68875dbadee5e63',uuid=5d6517f0-c4f0-4b35-a94a-610058ecc687,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37163c3c-1128-4143-af68-134f3f922fa2", "address": "fa:16:3e:1f:82:23", "network": {"id": "0c84d5db-4dde-46d7-8e55-dccce02872ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-146382199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "204fa09429ce4f2fafbc532805a346bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37163c3c-11", "ovs_interfaceid": "37163c3c-1128-4143-af68-134f3f922fa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Converting VIF {"id": "37163c3c-1128-4143-af68-134f3f922fa2", "address": "fa:16:3e:1f:82:23", "network": {"id": "0c84d5db-4dde-46d7-8e55-dccce02872ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-146382199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "204fa09429ce4f2fafbc532805a346bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37163c3c-11", "ovs_interfaceid": "37163c3c-1128-4143-af68-134f3f922fa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:82:23,bridge_name='br-int',has_traffic_filtering=True,id=37163c3c-1128-4143-af68-134f3f922fa2,network=Network(0c84d5db-4dde-46d7-8e55-dccce02872ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37163c3c-11') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG os_vif [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:82:23,bridge_name='br-int',has_traffic_filtering=True,id=37163c3c-1128-4143-af68-134f3f922fa2,network=Network(0c84d5db-4dde-46d7-8e55-dccce02872ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37163c3c-11') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37163c3c-11, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:22 user nova-compute[71516]: INFO os_vif [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:82:23,bridge_name='br-int',has_traffic_filtering=True,id=37163c3c-1128-4143-af68-134f3f922fa2,network=Network(0c84d5db-4dde-46d7-8e55-dccce02872ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37163c3c-11')
Apr 11 23:08:22 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Deleting instance files /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687_del
Apr 11 23:08:22 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Deletion of /opt/stack/data/nova/instances/5d6517f0-c4f0-4b35-a94a-610058ecc687_del complete
Apr 11 23:08:22 user nova-compute[71516]: INFO nova.compute.manager [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 11 23:08:22 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:08:22 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:08:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:23 user nova-compute[71516]: INFO nova.compute.manager [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Terminating instance
Apr 11 23:08:23 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:08:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-c66a1c3e-2db3-4732-bc63-5a072b89aaaf req-80951040-b120-460f-9a80-94338ce01e2d service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Received event network-vif-plugged-37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c66a1c3e-2db3-4732-bc63-5a072b89aaaf req-80951040-b120-460f-9a80-94338ce01e2d service nova] Acquiring lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c66a1c3e-2db3-4732-bc63-5a072b89aaaf req-80951040-b120-460f-9a80-94338ce01e2d service nova] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c66a1c3e-2db3-4732-bc63-5a072b89aaaf req-80951040-b120-460f-9a80-94338ce01e2d service nova] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-c66a1c3e-2db3-4732-bc63-5a072b89aaaf req-80951040-b120-460f-9a80-94338ce01e2d service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] No waiting events found dispatching network-vif-plugged-37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:24 user nova-compute[71516]: WARNING nova.compute.manager [req-c66a1c3e-2db3-4732-bc63-5a072b89aaaf req-80951040-b120-460f-9a80-94338ce01e2d service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Received unexpected event network-vif-plugged-37163c3c-1128-4143-af68-134f3f922fa2 for instance with vm_state active and task_state deleting.
Apr 11 23:08:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:08:24 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Took 1.26 seconds to deallocate network for instance.
Apr 11 23:08:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-c56a30bf-c1f3-4c90-bdd1-e6fd6b4f30ed req-1fa63297-e8c8-4062-9613-9ee43fac871c service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Received event network-vif-unplugged-7119bc80-98eb-47d6-b1b7-3ad91cae4256 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c56a30bf-c1f3-4c90-bdd1-e6fd6b4f30ed req-1fa63297-e8c8-4062-9613-9ee43fac871c service nova] Acquiring lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c56a30bf-c1f3-4c90-bdd1-e6fd6b4f30ed req-1fa63297-e8c8-4062-9613-9ee43fac871c service nova] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c56a30bf-c1f3-4c90-bdd1-e6fd6b4f30ed req-1fa63297-e8c8-4062-9613-9ee43fac871c service nova] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-c56a30bf-c1f3-4c90-bdd1-e6fd6b4f30ed req-1fa63297-e8c8-4062-9613-9ee43fac871c service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] No waiting events found dispatching network-vif-unplugged-7119bc80-98eb-47d6-b1b7-3ad91cae4256 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-c56a30bf-c1f3-4c90-bdd1-e6fd6b4f30ed req-1fa63297-e8c8-4062-9613-9ee43fac871c service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Received event network-vif-unplugged-7119bc80-98eb-47d6-b1b7-3ad91cae4256 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-584b421f-29d0-4d27-a036-9d1c2a05537a req-5b681f94-d2ba-4b64-8af7-72eada1c5bb6 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Received event network-vif-plugged-138c5b33-78b0-4ca8-a952-7be3e230441b {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-584b421f-29d0-4d27-a036-9d1c2a05537a req-5b681f94-d2ba-4b64-8af7-72eada1c5bb6 service nova] Acquiring lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-584b421f-29d0-4d27-a036-9d1c2a05537a req-5b681f94-d2ba-4b64-8af7-72eada1c5bb6 service nova] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-584b421f-29d0-4d27-a036-9d1c2a05537a req-5b681f94-d2ba-4b64-8af7-72eada1c5bb6 service nova] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-584b421f-29d0-4d27-a036-9d1c2a05537a req-5b681f94-d2ba-4b64-8af7-72eada1c5bb6 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] No waiting events found dispatching network-vif-plugged-138c5b33-78b0-4ca8-a952-7be3e230441b {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:24 user nova-compute[71516]: WARNING nova.compute.manager [req-584b421f-29d0-4d27-a036-9d1c2a05537a req-5b681f94-d2ba-4b64-8af7-72eada1c5bb6 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Received unexpected event network-vif-plugged-138c5b33-78b0-4ca8-a952-7be3e230441b for instance with vm_state building and task_state spawning.
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.543s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:24 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Deleted allocations for instance 5d6517f0-c4f0-4b35-a94a-610058ecc687
Apr 11 23:08:24 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Instance destroyed successfully.
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lazy-loading 'resources' on Instance uuid 11799d90-83b6-4553-9a8f-287fdbb3cf3a {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1375177297',display_name='tempest-ServersNegativeTestJSON-server-1375177297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1375177297',id=12,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c3e11fd040149dd8f5a130a9682a59c',ramdisk_id='',reservation_id='r-0xfj0j23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1318055293',owner_user_name='tempest-ServersNegativeTestJSON-1318055293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:06:41Z,user_data=None,user_id='859ae6c19707455ebf82bf532c9e10c0',uuid=11799d90-83b6-4553-9a8f-287fdbb3cf3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "address": "fa:16:3e:83:f3:11", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7119bc80-98", "ovs_interfaceid": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Converting VIF {"id": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "address": "fa:16:3e:83:f3:11", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7119bc80-98", "ovs_interfaceid": "7119bc80-98eb-47d6-b1b7-3ad91cae4256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f3:11,bridge_name='br-int',has_traffic_filtering=True,id=7119bc80-98eb-47d6-b1b7-3ad91cae4256,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7119bc80-98') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG os_vif [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f3:11,bridge_name='br-int',has_traffic_filtering=True,id=7119bc80-98eb-47d6-b1b7-3ad91cae4256,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7119bc80-98') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7119bc80-98, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:08:24 user nova-compute[71516]: INFO os_vif [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f3:11,bridge_name='br-int',has_traffic_filtering=True,id=7119bc80-98eb-47d6-b1b7-3ad91cae4256,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7119bc80-98')
Apr 11 23:08:24 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Deleting instance files /opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a_del
Apr 11 23:08:24 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Deletion of /opt/stack/data/nova/instances/11799d90-83b6-4553-9a8f-287fdbb3cf3a_del complete
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "5d6517f0-c4f0-4b35-a94a-610058ecc687" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.315s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:24 user nova-compute[71516]: INFO nova.compute.manager [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Took 1.42 seconds to destroy the instance on the hypervisor.
Apr 11 23:08:24 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:08:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:25 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Updating instance_info_cache with network_info: [{"id": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "address": "fa:16:3e:e1:c0:a4", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac411bad-03", "ovs_interfaceid": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:08:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:08:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:08:25 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:08:25 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254490.3819513, 902899b9-8c8f-404e-a110-832b3c91d526 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:08:25 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] VM Stopped (Lifecycle Event)
Apr 11 23:08:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a8b7379d-eb89-4dc6-8b3a-02cadd95b998 None None] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:25 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:08:25 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Took 0.94 seconds to deallocate network for instance.
Apr 11 23:08:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-1af195da-7d48-4941-b5cf-e6fbf2ef4f45 req-eea4207f-bb1a-4557-b4d5-90e57324f307 service nova] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Received event network-vif-deleted-37163c3c-1128-4143-af68-134f3f922fa2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-1af195da-7d48-4941-b5cf-e6fbf2ef4f45 req-eea4207f-bb1a-4557-b4d5-90e57324f307 service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Received event network-vif-deleted-7119bc80-98eb-47d6-b1b7-3ad91cae4256 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-263f5ebc-ce20-48cb-b9f4-58678a825c73 req-424fe2c8-b07c-4105-97a8-d02efdc63d4f service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Received event network-vif-plugged-7119bc80-98eb-47d6-b1b7-3ad91cae4256 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-263f5ebc-ce20-48cb-b9f4-58678a825c73 req-424fe2c8-b07c-4105-97a8-d02efdc63d4f service nova] Acquiring lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-263f5ebc-ce20-48cb-b9f4-58678a825c73 req-424fe2c8-b07c-4105-97a8-d02efdc63d4f service nova] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-263f5ebc-ce20-48cb-b9f4-58678a825c73 req-424fe2c8-b07c-4105-97a8-d02efdc63d4f service nova] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-263f5ebc-ce20-48cb-b9f4-58678a825c73 req-424fe2c8-b07c-4105-97a8-d02efdc63d4f service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] No waiting events found dispatching network-vif-plugged-7119bc80-98eb-47d6-b1b7-3ad91cae4256 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:26 user nova-compute[71516]: WARNING nova.compute.manager [req-263f5ebc-ce20-48cb-b9f4-58678a825c73 req-424fe2c8-b07c-4105-97a8-d02efdc63d4f service nova] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Received unexpected event network-vif-plugged-7119bc80-98eb-47d6-b1b7-3ad91cae4256 for instance with vm_state deleted and task_state None.
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:26 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Deleted allocations for instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a
Apr 11 23:08:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "11799d90-83b6-4553-9a8f-287fdbb3cf3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.842s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-2827eb66-098e-4cd7-b715-dd036804c660 req-ed2cbcd6-b857-4bf0-9050-f729f6d290b3 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Received event network-vif-plugged-138c5b33-78b0-4ca8-a952-7be3e230441b {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2827eb66-098e-4cd7-b715-dd036804c660 req-ed2cbcd6-b857-4bf0-9050-f729f6d290b3 service nova] Acquiring lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2827eb66-098e-4cd7-b715-dd036804c660 req-ed2cbcd6-b857-4bf0-9050-f729f6d290b3 service nova] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2827eb66-098e-4cd7-b715-dd036804c660 req-ed2cbcd6-b857-4bf0-9050-f729f6d290b3 service nova] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-2827eb66-098e-4cd7-b715-dd036804c660 req-ed2cbcd6-b857-4bf0-9050-f729f6d290b3 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] No waiting events found dispatching network-vif-plugged-138c5b33-78b0-4ca8-a952-7be3e230441b {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:26 user nova-compute[71516]: WARNING nova.compute.manager [req-2827eb66-098e-4cd7-b715-dd036804c660 req-ed2cbcd6-b857-4bf0-9050-f729f6d290b3 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Received unexpected event network-vif-plugged-138c5b33-78b0-4ca8-a952-7be3e230441b for instance with vm_state building and task_state spawning.
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254506.8263872, 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:08:26 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] VM Resumed (Lifecycle Event)
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:08:26 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Instance spawned successfully.
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:26 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254506.8301404, 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:08:26 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] VM Started (Lifecycle Event)
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:08:26 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:08:26 user nova-compute[71516]: INFO nova.compute.manager [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Took 6.39 seconds to spawn the instance on the hypervisor.
Apr 11 23:08:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:27 user nova-compute[71516]: INFO nova.compute.manager [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Took 11.86 seconds to build instance.
Apr 11 23:08:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.984s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:27 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:08:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG nova.objects.instance [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'flavor' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.123s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:30 user nova-compute[71516]: INFO nova.compute.manager [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Attaching volume 5f2d798b-8277-4bd3-a36e-dd47771c3f8d to /dev/vdb
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG os_brick.utils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4657db0c-a439-4841-adc1-ed49cdd12f4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:30 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:08:30 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:08:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8070MB free_disk=26.476917266845703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e342e6-49b5-4d67-9315-892b8f3c6cf9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3556a135-7041-4e4a-8070-604ecb02a861]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5849a1-99ff-44bb-940b-a51251e1a231]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:08:30 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:08:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[09294f73-9ec5-4a29-90a5-7655625ba806]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG os_brick.utils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== get_connector_properties: return (691ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating existing volume attachment record: 8d3b0770-4ee8-4fc7-adf5-1cab9865a998 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 4f95b120-0c70-45a5-969f-c1728c72d420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 04b926fc-370b-485a-ad51-944ba0791ebb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:08:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:08:31 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:08:31 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:08:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:08:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "4f95b120-0c70-45a5-969f-c1728c72d420" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG nova.objects.instance [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'flavor' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "4f95b120-0c70-45a5-969f-c1728c72d420" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "4f95b120-0c70-45a5-969f-c1728c72d420" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:32 user nova-compute[71516]: INFO nova.compute.manager [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Attaching volume 5d576508-63a9-4c1c-8b86-952f4522ecd4 to /dev/vdb
Apr 11 23:08:32 user nova-compute[71516]: DEBUG os_brick.utils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b0d92d-c51a-40ec-a9c3-0afca6f74b0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc907b2-a406-47d0-ad2f-430e2fb4650b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[78390e14-26e4-4780-a653-e8382f9706eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60b5cf0-c687-4ffe-987a-d9769c8fec7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:08:32 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:08:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b55643-8cd2-4c2c-9219-a8afcf4e06eb]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG os_brick.utils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:08:32 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updating existing volume attachment record: 580f663b-8d98-45d6-a2d8-6662046d5430 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:08:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAYIUBMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:08:35 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:08:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:35 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:08:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:35 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[88def687-ddd9-46f7-b554-d8044563579f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:08:35 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f7c1dd-e8d8-48ae-a77f-5893c612ab42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d] added
Apr 11 23:08:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2802e53f-db0f-463b-9246-ffc33ec85d86]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7193c5d4-abdb-438a-a0a4-dcbf283cf3fc]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pAYIUBMP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pAYIUBMP" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecc3644-e954-40a0-90e6-2166f32ef675]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pAYIUBMP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefd2fcc-8ac7-4cfe-98e8-b00b8a6c7207]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb45f786-7f87-4632-b374-dc1cd3173476]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:08:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0656e8-9fc6-4b86-aaad-f78cab8d4f6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260]
Apr 11 23:08:36 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260] successful.
Apr 11 23:08:36 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[931f1227-a7d9-479d-ac52-1d77c646128d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d35769-edb1-4580-a16d-84c4c2ffc813]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:36 user nova-compute[71516]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:36 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:36 user nova-compute[71516]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:36 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb6aec3-4011-4a91-a0a8-7675258edcfc]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:08:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAYIUBMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23737373462363830', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737373462363830', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG nova.objects.instance [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'flavor' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:08:37 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:08:37 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:08:37 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:08:37 user nova-compute[71516]:   <serial>5f2d798b-8277-4bd3-a36e-dd47771c3f8d</serial>
Apr 11 23:08:37 user nova-compute[71516]: </disk>
Apr 11 23:08:37 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No VIF found with MAC fa:16:3e:ec:10:5e, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254502.716414, 5d6517f0-c4f0-4b35-a94a-610058ecc687 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:08:37 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] VM Stopped (Lifecycle Event)
Apr 11 23:08:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c761eb71-f387-4688-93e4-5372c8e2ccdb None None] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYIrWqpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:08:37 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:08:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:37 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:08:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:37 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e187ce0d-f3ae-4f84-95c0-1fb0b5871cc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:08:37 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.731s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a316eb38-e9ad-4c31-b81d-22a2466b40f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4] added
Apr 11 23:08:37 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f396e4fd-4aec-4895-ae86-c1880ff66a92]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6115043b-818d-461e-9e90-a6d8caf5b3eb]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYIrWqpo {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYIrWqpo" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10a20b4-5810-4785-bca6-7b7b654db654]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AYIrWqpo'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[27db2798-addd-4f01-95c6-748f949d303f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a1d18b-cd4e-4afc-b089-aba51b7bffb7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:38 user nova-compute[71516]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:38 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:38 user nova-compute[71516]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:38 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc28e3b5-9d8c-480f-bd2f-609bbf187e8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4, portal: 172.16.0.220,3260]
Apr 11 23:08:38 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4, portal: 172.16.0.220,3260] successful.
Apr 11 23:08:38 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9973667b-a3e1-4f8e-9173-35390924c06d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb3128d-9312-438f-8e01-b75f4f8bb8a0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:38 user nova-compute[71516]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:38 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:38 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:38 user nova-compute[71516]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:38 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:38 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1324a601-8b3e-4d84-8589-2a0e4f305f8d]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYIrWqpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:08:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23263666233386433', 'path': '/dev/sdd'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263666233386433', 'path': '/dev/sdd'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.objects.instance [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'flavor' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:08:39 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:08:39 user nova-compute[71516]:   <source dev="/dev/sdd"/>
Apr 11 23:08:39 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:08:39 user nova-compute[71516]:   <serial>5d576508-63a9-4c1c-8b86-952f4522ecd4</serial>
Apr 11 23:08:39 user nova-compute[71516]: </disk>
Apr 11 23:08:39 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:08:39 user nova-compute[71516]: INFO nova.compute.manager [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Rebuilding instance
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] No VIF found with MAC fa:16:3e:24:ca:37, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.objects.instance [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'trusted_certs' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.objects.instance [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'pci_requests' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "4f95b120-0c70-45a5-969f-c1728c72d420" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.407s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.objects.instance [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'pci_devices' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.objects.instance [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'resources' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254504.837719, 11799d90-83b6-4553-9a8f-287fdbb3cf3a => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:08:39 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] VM Stopped (Lifecycle Event)
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.objects.instance [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'migration_context' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-312b98ac-29ec-483e-b0a1-1afb9babd6bc None None] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG nova.objects.instance [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71516) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "8322b884-2831-48af-a67e-26c31c17f49f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:39 user nova-compute[71516]: INFO nova.compute.manager [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Unshelving
Apr 11 23:08:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:40 user nova-compute[71516]: INFO nova.virt.block_device [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Booting with volume 12247dde-59fb-47e6-b624-bc8b349687a0 at /dev/vdc
Apr 11 23:08:40 user nova-compute[71516]: DEBUG os_brick.utils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG nova.compute.manager [req-785754af-06a3-4fea-9fad-c69e9375292b req-43a932c6-c2e7-49b0-99aa-46c840f911b2 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-unplugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-785754af-06a3-4fea-9fad-c69e9375292b req-43a932c6-c2e7-49b0-99aa-46c840f911b2 service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-785754af-06a3-4fea-9fad-c69e9375292b req-43a932c6-c2e7-49b0-99aa-46c840f911b2 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-785754af-06a3-4fea-9fad-c69e9375292b req-43a932c6-c2e7-49b0-99aa-46c840f911b2 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG nova.compute.manager [req-785754af-06a3-4fea-9fad-c69e9375292b req-43a932c6-c2e7-49b0-99aa-46c840f911b2 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-unplugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:40 user nova-compute[71516]: WARNING nova.compute.manager [req-785754af-06a3-4fea-9fad-c69e9375292b req-43a932c6-c2e7-49b0-99aa-46c840f911b2 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-unplugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state active and task_state rebuilding.
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9d8c92-3c62-4f33-bb36-02f558561b57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ae17e5-a2f0-44a9-8e8e-85d3bfc5392a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3217470-1458-412f-bea1-5bbd9022c524]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff42b203-adbe-4bee-b476-098bcb11ee3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:08:40 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8b70f0-9dac-4d33-8f8a-3fb7cdcdac6e]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG os_brick.utils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updating existing volume attachment record: bb273ab7-b4be-4241-b649-516802885772 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:40 user nova-compute[71516]: INFO nova.compute.manager [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Rescuing
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquired lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:08:40 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance destroyed successfully.
Apr 11 23:08:40 user nova-compute[71516]: INFO nova.compute.manager [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Detaching volume 5f2d798b-8277-4bd3-a36e-dd47771c3f8d
Apr 11 23:08:40 user nova-compute[71516]: INFO nova.virt.block_device [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Attempting to driver detach volume 5f2d798b-8277-4bd3-a36e-dd47771c3f8d from mountpoint /dev/vdb
Apr 11 23:08:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Attempting to detach device vdb from instance eed8cea5-9e5c-4467-8993-456cb3235fd8 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:08:40 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:08:40 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:08:40 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:08:40 user nova-compute[71516]:   <serial>5f2d798b-8277-4bd3-a36e-dd47771c3f8d</serial>
Apr 11 23:08:40 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:08:40 user nova-compute[71516]: </disk>
Apr 11 23:08:40 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:08:40 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully detached device vdb from instance eed8cea5-9e5c-4467-8993-456cb3235fd8 from the persistent domain config.
Apr 11 23:08:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAYIUBMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:08:40 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 23:08:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb27809-b160-49c7-83eb-ec8d5095401b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:08:40 user nova-compute[71516]: No targets found.
Apr 11 23:08:40 user nova-compute[71516]: iSNS:
Apr 11 23:08:40 user nova-compute[71516]: No targets found.
Apr 11 23:08:40 user nova-compute[71516]: STATIC:
Apr 11 23:08:40 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d
Apr 11 23:08:40 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:08:40 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:08:40 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5
Apr 11 23:08:40 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:08:40 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:08:40 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4
Apr 11 23:08:40 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:08:40 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:08:40 user nova-compute[71516]: FIRMWARE:
Apr 11 23:08:40 user nova-compute[71516]: No targets found.
Apr 11 23:08:40 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:08:40 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:08:40 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:40 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[280064e3-740a-4493-9282-3bff318e2118]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6eedbe-b080-4496-834c-784e14e2c3b9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:41 user nova-compute[71516]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:41 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:41 user nova-compute[71516]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:41 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c57f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f5769d-e195-425d-8005-6f06480965cf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae748866-94cc-4250-af41-87e593b9dd72]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5b29b9-4a75-4884-b9bb-8a3bf7f81b6e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[48029189-1430-4d74-a4f1-9efa9cd86c77]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[330c65e5-8066-47ab-9eb1-0d4527a440bd]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82d1e07-4336-41db-a64a-a42ceaa0669d]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260]
Apr 11 23:08:41 user nova-compute[71516]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260] successful.
Apr 11 23:08:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f46966-e16e-4f99-9f29-79ab64250ab7]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== disconnect_volume: return (354ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG nova.network.neutron [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updating instance_info_cache with network_info: [{"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Releasing lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance destroyed successfully.
Apr 11 23:08:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1831107086',display_name='tempest-ServerActionsTestJSON-server-1247380178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1831107086',id=2,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-pn29cvap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=eed8cea5-9e5c-4467-8993-456cb3235fd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_vif [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap961d8195-c0, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:42 user nova-compute[71516]: WARNING nova.compute.manager [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state active and task_state rebuilding.
Apr 11 23:08:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-unplugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] No waiting events found dispatching network-vif-unplugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:42 user nova-compute[71516]: WARNING nova.compute.manager [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received unexpected event network-vif-unplugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance with vm_state active and task_state rescuing.
Apr 11 23:08:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:42 user nova-compute[71516]: INFO os_vif [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0')
Apr 11 23:08:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAYIUBMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:08:42 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[820c0fb8-694e-4bde-8bb9-279aff770a73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:08:42 user nova-compute[71516]: No targets found.
Apr 11 23:08:42 user nova-compute[71516]: iSNS:
Apr 11 23:08:42 user nova-compute[71516]: No targets found.
Apr 11 23:08:42 user nova-compute[71516]: STATIC:
Apr 11 23:08:42 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5
Apr 11 23:08:42 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:08:42 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:08:42 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4
Apr 11 23:08:42 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:08:42 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:08:42 user nova-compute[71516]: FIRMWARE:
Apr 11 23:08:42 user nova-compute[71516]: No targets found.
Apr 11 23:08:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:08:42 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:08:42 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[981ae716-1a4e-4eee-8c0c-b4916862b4e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4ab255-86ea-4bfa-a1fa-094c93663cf2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:42 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:42 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5fda1510>, {}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Disconnecting from: [] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== disconnect_volume: return (84ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:08:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Deleting instance files /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8_del
Apr 11 23:08:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Deletion of /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8_del complete
Apr 11 23:08:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Instance destroyed successfully.
Apr 11 23:08:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Attempting a stable device rescue
Apr 11 23:08:42 user nova-compute[71516]: INFO nova.virt.block_device [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Booting with volume 5f2d798b-8277-4bd3-a36e-dd47771c3f8d at /dev/vdb
Apr 11 23:08:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71516) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Instance directory exists: not creating {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 23:08:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Creating image(s)
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "/opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "/opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG nova.objects.instance [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG os_brick.utils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "79830ac3e79d3b7e0ec96ba998ea7559739a2a73" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "79830ac3e79d3b7e0ec96ba998ea7559739a2a73" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[285bb4fa-bc63-4334-83e6-b2778b352bf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4f2ed2-bbcb-4108-82e1-b34c87cd20f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[380f4f31-c7b1-453a-9c88-38c629823622]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b309c8e3-3b10-4935-ac58-c2153d487c19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73.part --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:08:43 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:08:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c48877f-6230-40ae-a288-8182cd7c96ec]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG os_brick.utils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== get_connector_properties: return (1070ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating existing volume attachment record: ea9ebf9c-13e2-4323-964a-3c1f8e5b63d3 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73.part --force-share --output=json" returned: 0 in 0.171s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG nova.virt.images [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 1d98e55d-ff92-4ffd-ba89-2fe05e161b7a was qcow2, converting to raw {{(pid=71516) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:08:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73.part /opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73.converted {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73.part /opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73.converted" returned: 0 in 0.485s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73.converted --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-02310b51-356c-40d0-b8b0-93f3b3201958 req-65590be3-67e0-4c09-b3f3-b2eedf46b9c8 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-02310b51-356c-40d0-b8b0-93f3b3201958 req-65590be3-67e0-4c09-b3f3-b2eedf46b9c8 service nova] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-02310b51-356c-40d0-b8b0-93f3b3201958 req-65590be3-67e0-4c09-b3f3-b2eedf46b9c8 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-02310b51-356c-40d0-b8b0-93f3b3201958 req-65590be3-67e0-4c09-b3f3-b2eedf46b9c8 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-02310b51-356c-40d0-b8b0-93f3b3201958 req-65590be3-67e0-4c09-b3f3-b2eedf46b9c8 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] No waiting events found dispatching network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:44 user nova-compute[71516]: WARNING nova.compute.manager [req-02310b51-356c-40d0-b8b0-93f3b3201958 req-65590be3-67e0-4c09-b3f3-b2eedf46b9c8 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received unexpected event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance with vm_state active and task_state rescuing.
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "79830ac3e79d3b7e0ec96ba998ea7559739a2a73" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.870s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "79830ac3e79d3b7e0ec96ba998ea7559739a2a73" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "79830ac3e79d3b7e0ec96ba998ea7559739a2a73" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73 --force-share --output=json" returned: 0 in 0.175s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73,backing_fmt=raw /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.rescue {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73,backing_fmt=raw /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.rescue" returned: 0 in 0.066s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "79830ac3e79d3b7e0ec96ba998ea7559739a2a73" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.objects.instance [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'migration_context' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Start _get_guest_xml network_info=[{"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "vif_mac": "fa:16:3e:24:ca:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1d98e55d-ff92-4ffd-ba89-2fe05e161b7a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYIrWqpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '4f95b120-0c70-45a5-969f-c1728c72d420', 'attached_at': '', 'detached_at': '', 'volume_id': '5d576508-63a9-4c1c-8b86-952f4522ecd4', 'serial': '5d576508-63a9-4c1c-8b86-952f4522ecd4'}, 'disk_bus': 'virtio', 'attachment_id': '580f663b-8d98-45d6-a2d8-6662046d5430', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.objects.instance [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'resources' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.objects.instance [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:44 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:08:44 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.objects.instance [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYIrWqpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:08:44 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:08:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:44 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:08:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:44 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d3e160-a4e7-427b-b760-0d9b96543c1b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = AYIrWqpo\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 23:08:45 user nova-compute[71516]: node.name = iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4
Apr 11 23:08:45 user nova-compute[71516]: node.tpgt = -1
Apr 11 23:08:45 user nova-compute[71516]: node.startup = automatic
Apr 11 23:08:45 user nova-compute[71516]: node.leading_login = No
Apr 11 23:08:45 user nova-compute[71516]: iface.iscsi_ifacename = default
Apr 11 23:08:45 user nova-compute[71516]: iface.net_ifacename = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.ipaddress = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.prefix_len = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.hwaddress = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.transport_name = tcp
Apr 11 23:08:45 user nova-compute[71516]: iface.initiatorname = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.state = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.vlan_id = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.vlan_priority = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.vlan_state = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.iface_num = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.mtu = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.port = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.bootproto = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.subnet_mask = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.gateway = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.dhcp_alt_client_id = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.dhcp_dns = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.dhcp_learn_iqn = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.dhcp_vendor_id_state = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.dhcp_vendor_id = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.dhcp_slp_da = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.fragmentation = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.gratuitous_arp = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.incoming_forwarding = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.tos_state = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.tos = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.ttl = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.delayed_ack = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.tcp_nagle = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.tcp_wsf_state = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.tcp_wsf = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.tcp_timer_scale = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.tcp_timestamp = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.redirect = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.def_task_mgmt_timeout = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.header_digest = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.data_digest = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.immediate_data = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.initial_r2t = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.data_seq_inorder = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.data_pdu_inorder = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.erl = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.max_receive_data_len = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.first_burst_len = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.max_outstanding_r2t = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.max_burst_len = 0
Apr 11 23:08:45 user nova-compute[71516]: iface.chap_auth = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.bidi_chap = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.strict_login_compliance = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.discovery_auth = <empty>
Apr 11 23:08:45 user nova-compute[71516]: iface.discovery_logout = <empty>
Apr 11 23:08:45 user nova-compute[71516]: node.discovery_address = <empty>
Apr 11 23:08:45 user nova-compute[71516]: node.discovery_port = 0
Apr 11 23:08:45 user nova-compute[71516]: node.discovery_type = static
Apr 11 23:08:45 user nova-compute[71516]: node.session.initial_cmdsn = 0
Apr 11 23:08:45 user nova-compute[71516]: node.session.initial_login_retry_max = 8
Apr 11 23:08:45 user nova-compute[71516]: node.session.xmit_thread_priority = -20
Apr 11 23:08:45 user nova-compute[71516]: node.session.cmds_max = 128
Apr 11 23:08:45 user nova-compute[71516]: node.session.queue_depth = 32
Apr 11 23:08:45 user nova-compute[71516]: node.session.nr_sessions = 1
Apr 11 23:08:45 user nova-compute[71516]: node.session.auth.authmethod = CHAP
Apr 11 23:08:45 user nova-compute[71516]: node.session.auth.username = AYIrWqpo
Apr 11 23:08:45 user nova-compute[71516]: node.session.auth.password = ***
Apr 11 23:08:45 user nova-compute[71516]: node.session.auth.username_in = <empty>
Apr 11 23:08:45 user nova-compute[71516]: node.session.auth.password_in = <empty>
Apr 11 23:08:45 user nova-compute[71516]: node.session.auth.chap_algs = MD5
Apr 11 23:08:45 user nova-compute[71516]: node.session.timeo.replacement_timeout = 120
Apr 11 23:08:45 user nova-compute[71516]: node.session.err_timeo.abort_timeout = 15
Apr 11 23:08:45 user nova-compute[71516]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 23:08:45 user nova-compute[71516]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 23:08:45 user nova-compute[71516]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 23:08:45 user nova-compute[71516]: node.session.iscsi.FastAbort = Yes
Apr 11 23:08:45 user nova-compute[71516]: node.session.iscsi.InitialR2T = No
Apr 11 23:08:45 user nova-compute[71516]: node.session.iscsi.ImmediateData = Yes
Apr 11 23:08:45 user nova-compute[71516]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 23:08:45 user nova-compute[71516]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 23:08:45 user nova-compute[71516]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 23:08:45 user nova-compute[71516]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 23:08:45 user nova-compute[71516]: node.session.iscsi.MaxConnections = 1
Apr 11 23:08:45 user nova-compute[71516]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 23:08:45 user nova-compute[71516]: node.session.iscsi.ERL = 0
Apr 11 23:08:45 user nova-compute[71516]: node.session.scan = manual
Apr 11 23:08:45 user nova-compute[71516]: node.session.reopen_max = 0
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].address = 172.16.0.220
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].port = 3260
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].startup = manual
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].tcp.window_size = 524288
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].tcp.type_of_service = 0
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].timeo.logout_timeout = 15
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].timeo.login_timeout = 15
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].timeo.auth_timeout = 45
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].iscsi.DataDigest = None
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].iscsi.IFMarker = No
Apr 11 23:08:45 user nova-compute[71516]: node.conn[0].iscsi.OFMarker = No
Apr 11 23:08:45 user nova-compute[71516]: # END RECORD
Apr 11 23:08:45 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[492505ce-953c-47f6-bb96-36099b0f6c94]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fe3e57-f99a-418d-b323-e0fb858614b6]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYIrWqpo {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYIrWqpo" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b297358c-4cc2-419c-a26c-79885e62d610]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AYIrWqpo'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad5ef77-a526-4353-89a3-a88b9fab2088]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80ed264-e1c3-480e-b0d2-6194c9bdf14a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:45 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:45 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:45 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:45 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] HCTL ('35', '0', '0', 0) found on session 17 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f97637a-fad5-4639-b747-300f2d4e5c7e]: (4, ('0 0 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Searching for a device in session 17 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYIrWqpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] <== connect_volume: return (195ms) {'type': 'block', 'scsi_wwn': '23263666233386433', 'path': '/dev/sdd'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263666233386433', 'path': '/dev/sdd'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:04:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-229868185',display_name='tempest-ServerStableDeviceRescueTest-server-229868185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-229868185',id=3,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE9QDWoeyAk5NPp++qY0mw94h70wgQ85QXWkrvjtaSwwpbB/vlw81NpI+lMUuo71+oPbM1g+FT373UgIfaZ8VyRJDzOgtgdrI0cP+MdyqWrhTvd1yMzfPZXk/mcG9NWEw==',key_name='tempest-keypair-24963563',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:04:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8550fae43fa54d9a99dedf1d8e3bf0d0',ramdisk_id='',reservation_id='r-wtsmu0zf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2037080891',owner_user_name='tempest-ServerStableDeviceRescueTest-2037080891-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:06:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9e926b3053c4258a3340d19ae40a7a9',uuid=4f95b120-0c70-45a5-969f-c1728c72d420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "vif_mac": "fa:16:3e:24:ca:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Converting VIF {"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "vif_mac": "fa:16:3e:24:ca:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:ca:37,bridge_name='br-int',has_traffic_filtering=True,id=7a130357-a93e-4aad-8404-d4b5b8dd7022,network=Network(a4b59436-3706-4c0a-97c0-b11230ce2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a130357-a9') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG nova.objects.instance [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:08:45 user nova-compute[71516]:   <uuid>4f95b120-0c70-45a5-969f-c1728c72d420</uuid>
Apr 11 23:08:45 user nova-compute[71516]:   <name>instance-00000003</name>
Apr 11 23:08:45 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:08:45 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:08:45 user nova-compute[71516]:   <metadata>
Apr 11 23:08:45 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:08:45 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:08:45 user nova-compute[71516]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-229868185</nova:name>
Apr 11 23:08:45 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:08:44</nova:creationTime>
Apr 11 23:08:45 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:08:45 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:08:45 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:08:45 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:08:45 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:08:45 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:08:45 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:08:45 user nova-compute[71516]:       <nova:owner>
Apr 11 23:08:45 user nova-compute[71516]:         <nova:user uuid="e9e926b3053c4258a3340d19ae40a7a9">tempest-ServerStableDeviceRescueTest-2037080891-project-member</nova:user>
Apr 11 23:08:45 user nova-compute[71516]:         <nova:project uuid="8550fae43fa54d9a99dedf1d8e3bf0d0">tempest-ServerStableDeviceRescueTest-2037080891</nova:project>
Apr 11 23:08:45 user nova-compute[71516]:       </nova:owner>
Apr 11 23:08:45 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:08:45 user nova-compute[71516]:       <nova:ports>
Apr 11 23:08:45 user nova-compute[71516]:         <nova:port uuid="7a130357-a93e-4aad-8404-d4b5b8dd7022">
Apr 11 23:08:45 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 23:08:45 user nova-compute[71516]:         </nova:port>
Apr 11 23:08:45 user nova-compute[71516]:       </nova:ports>
Apr 11 23:08:45 user nova-compute[71516]:     </nova:instance>
Apr 11 23:08:45 user nova-compute[71516]:   </metadata>
Apr 11 23:08:45 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:08:45 user nova-compute[71516]:     <system>
Apr 11 23:08:45 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:08:45 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:08:45 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:08:45 user nova-compute[71516]:       <entry name="serial">4f95b120-0c70-45a5-969f-c1728c72d420</entry>
Apr 11 23:08:45 user nova-compute[71516]:       <entry name="uuid">4f95b120-0c70-45a5-969f-c1728c72d420</entry>
Apr 11 23:08:45 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:08:45 user nova-compute[71516]:     </system>
Apr 11 23:08:45 user nova-compute[71516]:   </sysinfo>
Apr 11 23:08:45 user nova-compute[71516]:   <os>
Apr 11 23:08:45 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:08:45 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:08:45 user nova-compute[71516]:   </os>
Apr 11 23:08:45 user nova-compute[71516]:   <features>
Apr 11 23:08:45 user nova-compute[71516]:     <acpi/>
Apr 11 23:08:45 user nova-compute[71516]:     <apic/>
Apr 11 23:08:45 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:08:45 user nova-compute[71516]:   </features>
Apr 11 23:08:45 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:08:45 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:08:45 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:08:45 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:08:45 user nova-compute[71516]:   </clock>
Apr 11 23:08:45 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:08:45 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:08:45 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:08:45 user nova-compute[71516]:   </cpu>
Apr 11 23:08:45 user nova-compute[71516]:   <devices>
Apr 11 23:08:45 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:08:45 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:08:45 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk"/>
Apr 11 23:08:45 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:08:45 user nova-compute[71516]:     </disk>
Apr 11 23:08:45 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:08:45 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:08:45 user nova-compute[71516]:       <source dev="/dev/sdd"/>
Apr 11 23:08:45 user nova-compute[71516]:       <target dev="vdb" bus="virtio"/>
Apr 11 23:08:45 user nova-compute[71516]:       <serial>5d576508-63a9-4c1c-8b86-952f4522ecd4</serial>
Apr 11 23:08:45 user nova-compute[71516]:     </disk>
Apr 11 23:08:45 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:08:45 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:08:45 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.rescue"/>
Apr 11 23:08:45 user nova-compute[71516]:       <target dev="vdc" bus="virtio"/>
Apr 11 23:08:45 user nova-compute[71516]:       <boot order="1"/>
Apr 11 23:08:45 user nova-compute[71516]:     </disk>
Apr 11 23:08:45 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:08:45 user nova-compute[71516]:       <mac address="fa:16:3e:24:ca:37"/>
Apr 11 23:08:45 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:08:45 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:08:45 user nova-compute[71516]:       <target dev="tap7a130357-a9"/>
Apr 11 23:08:45 user nova-compute[71516]:     </interface>
Apr 11 23:08:45 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:08:45 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/console.log" append="off"/>
Apr 11 23:08:45 user nova-compute[71516]:     </serial>
Apr 11 23:08:45 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:08:45 user nova-compute[71516]:     <video>
Apr 11 23:08:45 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:08:45 user nova-compute[71516]:     </video>
Apr 11 23:08:45 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:08:45 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:08:45 user nova-compute[71516]:     </rng>
Apr 11 23:08:45 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:08:45 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:08:45 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:08:45 user nova-compute[71516]:     </memballoon>
Apr 11 23:08:45 user nova-compute[71516]:   </devices>
Apr 11 23:08:45 user nova-compute[71516]: </domain>
Apr 11 23:08:45 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:08:45 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Instance destroyed successfully.
Apr 11 23:08:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] No VIF found with MAC fa:16:3e:24:ca:37, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'pci_requests' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'numa_topology' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:45 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:08:45 user nova-compute[71516]: INFO nova.compute.claims [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Claim successful on node user
Apr 11 23:08:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:46 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:08:46 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:08:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:46 user nova-compute[71516]: INFO nova.network.neutron [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updating port b44a27e4-9811-4e81-8f41-c7f58def46bc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 23:08:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG nova.compute.manager [req-362ec59b-581d-4253-a895-d661fa544fab req-8ef5be74-0172-43d9-9360-993189954528 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-362ec59b-581d-4253-a895-d661fa544fab req-8ef5be74-0172-43d9-9360-993189954528 service nova] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-362ec59b-581d-4253-a895-d661fa544fab req-8ef5be74-0172-43d9-9360-993189954528 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-362ec59b-581d-4253-a895-d661fa544fab req-8ef5be74-0172-43d9-9360-993189954528 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG nova.compute.manager [req-362ec59b-581d-4253-a895-d661fa544fab req-8ef5be74-0172-43d9-9360-993189954528 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] No waiting events found dispatching network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:47 user nova-compute[71516]: WARNING nova.compute.manager [req-362ec59b-581d-4253-a895-d661fa544fab req-8ef5be74-0172-43d9-9360-993189954528 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received unexpected event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance with vm_state active and task_state rescuing.
Apr 11 23:08:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquired lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG nova.compute.manager [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-changed-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG nova.compute.manager [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Refreshing instance network info cache due to event network-changed-b44a27e4-9811-4e81-8f41-c7f58def46bc. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] Acquiring lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:47 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updating instance_info_cache with network_info: [{"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Releasing lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:08:48 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Creating image(s)
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "/opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "/opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "/opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] Acquired lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG nova.network.neutron [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Refreshing network info cache for port b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f2a79a44-800e-4142-b778-aae06a5c779d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2a79a44-800e-4142-b778-aae06a5c779d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "a109b12059115c500ce3bad4ac9bae065665a309" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "a109b12059115c500ce3bad4ac9bae065665a309" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309.part --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:08:48 user nova-compute[71516]: INFO nova.compute.claims [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Claim successful on node user
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309.part --force-share --output=json" returned: 0 in 0.151s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG nova.virt.images [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 1e2d8073-da39-4d01-8111-69c226b39850 was qcow2, converting to raw {{(pid=71516) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:08:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309.part /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309.converted {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:08:49 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Creating image(s)
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309.part /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309.converted" returned: 0 in 0.236s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309.converted --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.compute.manager [req-1419a26e-2325-4078-872a-e5c5ac537fc1 req-e0831c93-e82c-46d3-b859-ce6f1c45be89 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1419a26e-2325-4078-872a-e5c5ac537fc1 req-e0831c93-e82c-46d3-b859-ce6f1c45be89 service nova] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1419a26e-2325-4078-872a-e5c5ac537fc1 req-e0831c93-e82c-46d3-b859-ce6f1c45be89 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1419a26e-2325-4078-872a-e5c5ac537fc1 req-e0831c93-e82c-46d3-b859-ce6f1c45be89 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.compute.manager [req-1419a26e-2325-4078-872a-e5c5ac537fc1 req-e0831c93-e82c-46d3-b859-ce6f1c45be89 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] No waiting events found dispatching network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:49 user nova-compute[71516]: WARNING nova.compute.manager [req-1419a26e-2325-4078-872a-e5c5ac537fc1 req-e0831c93-e82c-46d3-b859-ce6f1c45be89 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received unexpected event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance with vm_state active and task_state rescuing.
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.149s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "a109b12059115c500ce3bad4ac9bae065665a309" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.201s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.network.neutron [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updated VIF entry in instance network info cache for port b44a27e4-9811-4e81-8f41-c7f58def46bc. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.network.neutron [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updating instance_info_cache with network_info: [{"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] Releasing lock "refresh_cache-8322b884-2831-48af-a67e-26c31c17f49f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk 1073741824" returned: 0 in 0.061s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309 --force-share --output=json" returned: 0 in 0.199s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "a109b12059115c500ce3bad4ac9bae065665a309" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "a109b12059115c500ce3bad4ac9bae065665a309" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for 4f95b120-0c70-45a5-969f-c1728c72d420 due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254529.6636646, 4f95b120-0c70-45a5-969f-c1728c72d420 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:08:49 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] VM Resumed (Lifecycle Event)
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.149s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309 --force-share --output=json" returned: 0 in 0.151s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309,backing_fmt=raw /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.855s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.177s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309,backing_fmt=raw /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk 1073741824" returned: 0 in 0.071s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "a109b12059115c500ce3bad4ac9bae065665a309" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Cannot resize image /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Ensure instance console log exists: /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Start _get_guest_xml network_info=[{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAYIUBMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eed8cea5-9e5c-4467-8993-456cb3235fd8', 'attached_at': '', 'detached_at': '', 'volume_id': '5f2d798b-8277-4bd3-a36e-dd47771c3f8d', 'serial': '5f2d798b-8277-4bd3-a36e-dd47771c3f8d'}, 'disk_bus': 'virtio', 'attachment_id': 'ea9ebf9c-13e2-4323-964a-3c1f8e5b63d3', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.network.neutron [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254529.6641972, 4f95b120-0c70-45a5-969f-c1728c72d420 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:08:49 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] VM Started (Lifecycle Event)
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:08:49 user nova-compute[71516]: INFO nova.compute.claims [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Claim successful on node user
Apr 11 23:08:49 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:49 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 23:08:49 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.objects.instance [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'vcpu_model' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:08:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAYIUBMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:08:50 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:50 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:50 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309 --force-share --output=json" returned: 0 in 0.189s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'migration_context' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Rebasing disk image.
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[950446ee-7ba0-4450-9b23-0b3ec90f467b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG nova.policy [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:08:50 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efd55f1-6548-4136-a0cd-497aaa587e11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d] added
Apr 11 23:08:50 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e76043-c3db-4d33-be8a-007800b6928f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bc26a6-60dd-405c-8bc6-d009017265e8]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:08:50 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Creating image(s)
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "/opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "/opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pAYIUBMP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pAYIUBMP" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f92031c-77ae-43ee-b739-bd3315ec7fa6]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.224s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pAYIUBMP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 -F raw /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffe6e45-71e5-446a-8cb2-ffe2ccc31d79]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[33101d3e-efc1-4cbb-bae6-8152655c1675]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:50 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:50 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:50 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:50 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.171s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[18112ac8-72b4-453e-a218-91f012a405bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260]
Apr 11 23:08:50 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260] successful.
Apr 11 23:08:50 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecec04f-fa2c-4d6e-b52e-138f703567e9]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[de91a3de-c21e-4a64-8f31-0b564e616cd7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:50 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:50 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:50 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:50 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:50 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:50 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.502s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8823cf4e-bf8a-4f46-91b8-6e1256871b26]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAYIUBMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.187s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk 1073741824" returned: 0 in 0.085s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.946s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG nova.network.neutron [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.182s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:08:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:50 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:08:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Cannot resize image /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.objects.instance [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'migration_context' on Instance uuid f2a79a44-800e-4142-b778-aae06a5c779d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Ensure instance console log exists: /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:08:51 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Creating image(s)
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "/opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "/opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.policy [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.163s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.network.neutron [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Successfully created port: 970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.151s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk 1073741824" returned: 0 in 0.057s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.543s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== connect_volume: return (1547ms) {'type': 'block', 'scsi_wwn': '23737373462363830', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737373462363830', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1831107086',display_name='tempest-ServerActionsTestJSON-server-1247380178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1831107086',id=2,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-pn29cvap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:08:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=eed8cea5-9e5c-4467-8993-456cb3235fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:08:51 user nova-compute[71516]:   <uuid>eed8cea5-9e5c-4467-8993-456cb3235fd8</uuid>
Apr 11 23:08:51 user nova-compute[71516]:   <name>instance-00000002</name>
Apr 11 23:08:51 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:08:51 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:08:51 user nova-compute[71516]:   <metadata>
Apr 11 23:08:51 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:08:51 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:08:51 user nova-compute[71516]:       <nova:name>tempest-ServerActionsTestJSON-server-1247380178</nova:name>
Apr 11 23:08:51 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:08:49</nova:creationTime>
Apr 11 23:08:51 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:08:51 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:08:51 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:08:51 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:08:51 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:08:51 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:08:51 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:08:51 user nova-compute[71516]:       <nova:owner>
Apr 11 23:08:51 user nova-compute[71516]:         <nova:user uuid="ddc7eb14e7174babb8680b4020243c97">tempest-ServerActionsTestJSON-813592275-project-member</nova:user>
Apr 11 23:08:51 user nova-compute[71516]:         <nova:project uuid="2fca37343b414de6b008ad79e022f858">tempest-ServerActionsTestJSON-813592275</nova:project>
Apr 11 23:08:51 user nova-compute[71516]:       </nova:owner>
Apr 11 23:08:51 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:08:51 user nova-compute[71516]:       <nova:ports>
Apr 11 23:08:51 user nova-compute[71516]:         <nova:port uuid="961d8195-c0d7-49eb-bfd7-05ee4b3e6112">
Apr 11 23:08:51 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:08:51 user nova-compute[71516]:         </nova:port>
Apr 11 23:08:51 user nova-compute[71516]:       </nova:ports>
Apr 11 23:08:51 user nova-compute[71516]:     </nova:instance>
Apr 11 23:08:51 user nova-compute[71516]:   </metadata>
Apr 11 23:08:51 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:08:51 user nova-compute[71516]:     <system>
Apr 11 23:08:51 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:08:51 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:08:51 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:08:51 user nova-compute[71516]:       <entry name="serial">eed8cea5-9e5c-4467-8993-456cb3235fd8</entry>
Apr 11 23:08:51 user nova-compute[71516]:       <entry name="uuid">eed8cea5-9e5c-4467-8993-456cb3235fd8</entry>
Apr 11 23:08:51 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:08:51 user nova-compute[71516]:     </system>
Apr 11 23:08:51 user nova-compute[71516]:   </sysinfo>
Apr 11 23:08:51 user nova-compute[71516]:   <os>
Apr 11 23:08:51 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:08:51 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:08:51 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:08:51 user nova-compute[71516]:   </os>
Apr 11 23:08:51 user nova-compute[71516]:   <features>
Apr 11 23:08:51 user nova-compute[71516]:     <acpi/>
Apr 11 23:08:51 user nova-compute[71516]:     <apic/>
Apr 11 23:08:51 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:08:51 user nova-compute[71516]:   </features>
Apr 11 23:08:51 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:08:51 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:08:51 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:08:51 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:08:51 user nova-compute[71516]:   </clock>
Apr 11 23:08:51 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:08:51 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:08:51 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:08:51 user nova-compute[71516]:   </cpu>
Apr 11 23:08:51 user nova-compute[71516]:   <devices>
Apr 11 23:08:51 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:08:51 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:08:51 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk"/>
Apr 11 23:08:51 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:08:51 user nova-compute[71516]:     </disk>
Apr 11 23:08:51 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:08:51 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:08:51 user nova-compute[71516]:       <source dev="/dev/sdc"/>
Apr 11 23:08:51 user nova-compute[71516]:       <target dev="vdb" bus="virtio"/>
Apr 11 23:08:51 user nova-compute[71516]:       <serial>5f2d798b-8277-4bd3-a36e-dd47771c3f8d</serial>
Apr 11 23:08:51 user nova-compute[71516]:     </disk>
Apr 11 23:08:51 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:08:51 user nova-compute[71516]:       <mac address="fa:16:3e:ec:10:5e"/>
Apr 11 23:08:51 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:08:51 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:08:51 user nova-compute[71516]:       <target dev="tap961d8195-c0"/>
Apr 11 23:08:51 user nova-compute[71516]:     </interface>
Apr 11 23:08:51 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:08:51 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/console.log" append="off"/>
Apr 11 23:08:51 user nova-compute[71516]:     </serial>
Apr 11 23:08:51 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:08:51 user nova-compute[71516]:     <video>
Apr 11 23:08:51 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:08:51 user nova-compute[71516]:     </video>
Apr 11 23:08:51 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:08:51 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:08:51 user nova-compute[71516]:     </rng>
Apr 11 23:08:51 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:08:51 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:08:51 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:08:51 user nova-compute[71516]:     </memballoon>
Apr 11 23:08:51 user nova-compute[71516]:   </devices>
Apr 11 23:08:51 user nova-compute[71516]: </domain>
Apr 11 23:08:51 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1831107086',display_name='tempest-ServerActionsTestJSON-server-1247380178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1831107086',id=2,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-pn29cvap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:08:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=eed8cea5-9e5c-4467-8993-456cb3235fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG os_vif [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.195s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap961d8195-c0, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap961d8195-c0, col_values=(('external_ids', {'iface-id': '961d8195-c0d7-49eb-bfd7-05ee4b3e6112', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:10:5e', 'vm-uuid': 'eed8cea5-9e5c-4467-8993-456cb3235fd8'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:51 user nova-compute[71516]: INFO os_vif [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0')
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No VIF found with MAC fa:16:3e:ec:10:5e, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Cannot resize image /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.objects.instance [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'migration_context' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Ensure instance console log exists: /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.network.neutron [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Successfully created port: ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 -F raw /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk" returned: 0 in 2.304s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Ensure instance console log exists: /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Start _get_guest_xml network_info=[{"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='ca8acd4e0f32ab9c394e0bd70a4a9184',container_format='bare',created_at=2023-04-11T23:06:47Z,direct_url=<?>,disk_format='qcow2',id=1e2d8073-da39-4d01-8111-69c226b39850,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-742046125-shelved',owner='b466a7e141a247319eae64ab30aca760',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T23:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WIgkFsfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '8322b884-2831-48af-a67e-26c31c17f49f', 'attached_at': '', 'detached_at': '', 'volume_id': '12247dde-59fb-47e6-b624-bc8b349687a0', 'serial': '12247dde-59fb-47e6-b624-bc8b349687a0'}, 'disk_bus': 'virtio', 'attachment_id': 'bb273ab7-b4be-4241-b649-516802885772', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:08:52 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:08:52 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ca8acd4e0f32ab9c394e0bd70a4a9184',container_format='bare',created_at=2023-04-11T23:06:47Z,direct_url=<?>,disk_format='qcow2',id=1e2d8073-da39-4d01-8111-69c226b39850,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-742046125-shelved',owner='b466a7e141a247319eae64ab30aca760',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T23:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WIgkFsfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:08:52 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:52 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:08:52 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a0a777-bc84-4ce4-a079-3a24311a5d12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:08:52 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[574f6ba3-f7f1-4e33-8a82-6a69780c8a61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0] added
Apr 11 23:08:52 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.059s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca3700a-f468-4531-8400-0a9c05f03204]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[797f8f0e-9c73-4727-b2fa-068b317e040a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WIgkFsfM {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WIgkFsfM" returned: 0 in 0.034s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa741263-ab61-45df-a950-3a1c07ddee07]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WIgkFsfM'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ce884c-5302-4e92-af4d-abd8fd33badb]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c477dc1-c839-4bb9-9554-83166162775b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:52 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:52 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:52 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:52 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:52 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:52 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.network.neutron [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Successfully updated port: 970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "refresh_cache-f2a79a44-800e-4142-b778-aae06a5c779d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquired lock "refresh_cache-f2a79a44-800e-4142-b778-aae06a5c779d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG nova.network.neutron [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[686521ed-d2db-40dd-b7f7-5edc272fcb61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:52 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0, portal: 172.16.0.220,3260]
Apr 11 23:08:52 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0, portal: 172.16.0.220,3260] successful.
Apr 11 23:08:52 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Received event network-changed-970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Refreshing instance network info cache due to event network-changed-970d841b-bbfc-409e-8ec5-ddbea8be8c5d. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] Acquiring lock "refresh_cache-f2a79a44-800e-4142-b778-aae06a5c779d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[95616940-0130-4f1f-b155-65e621559469]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e4d8f4-5f1c-4d8d-9d66-8ae59540d57f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:53 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:53 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:53 user nova-compute[71516]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 (non-flash)
Apr 11 23:08:53 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:08:53 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:08:53 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:08:53 user nova-compute[71516]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 (non-flash)
Apr 11 23:08:53 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e12197c-8a4c-43c1-90b6-63b9835caf11]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WIgkFsfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-5c68e47d-6d1f-49fa-9912-c3f7a2e60545 req-fac2da09-213e-4ced-9a30-b9ea7fe8f4c9 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5c68e47d-6d1f-49fa-9912-c3f7a2e60545 req-fac2da09-213e-4ced-9a30-b9ea7fe8f4c9 service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5c68e47d-6d1f-49fa-9912-c3f7a2e60545 req-fac2da09-213e-4ced-9a30-b9ea7fe8f4c9 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5c68e47d-6d1f-49fa-9912-c3f7a2e60545 req-fac2da09-213e-4ced-9a30-b9ea7fe8f4c9 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-5c68e47d-6d1f-49fa-9912-c3f7a2e60545 req-fac2da09-213e-4ced-9a30-b9ea7fe8f4c9 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:53 user nova-compute[71516]: WARNING nova.compute.manager [req-5c68e47d-6d1f-49fa-9912-c3f7a2e60545 req-fac2da09-213e-4ced-9a30-b9ea7fe8f4c9 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state active and task_state rebuild_spawning.
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Updating instance_info_cache with network_info: [{"id": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "address": "fa:16:3e:16:12:b6", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970d841b-bb", "ovs_interfaceid": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Releasing lock "refresh_cache-f2a79a44-800e-4142-b778-aae06a5c779d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Instance network_info: |[{"id": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "address": "fa:16:3e:16:12:b6", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970d841b-bb", "ovs_interfaceid": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] Acquired lock "refresh_cache-f2a79a44-800e-4142-b778-aae06a5c779d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Refreshing network info cache for port 970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Start _get_guest_xml network_info=[{"id": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "address": "fa:16:3e:16:12:b6", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970d841b-bb", "ovs_interfaceid": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:08:53 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:08:53 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-294909853',display_name='tempest-AttachVolumeNegativeTest-server-294909853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-294909853',id=15,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0zqkr5JslO5pazVYnbydw15T9EjvLg2GhWoOpKqa/Wjsgfn0KXK0Lu5zOBrtqyynlBKK+TPkpstQuZbuDS46amji1YuAoDEopw7Gf9EJdnvh6SOK92JvEf778W3uX0Dg==',key_name='tempest-keypair-1101679830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f29d28c472c4f65b8437ce443d208c7',ramdisk_id='',reservation_id='r-dfiig29j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2123485934',owner_user_name='tempest-AttachVolumeNegativeTest-2123485934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da1389f3e27f49f394598636d041a9c9',uuid=f2a79a44-800e-4142-b778-aae06a5c779d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "address": "fa:16:3e:16:12:b6", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970d841b-bb", "ovs_interfaceid": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converting VIF {"id": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "address": "fa:16:3e:16:12:b6", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970d841b-bb", "ovs_interfaceid": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:12:b6,bridge_name='br-int',has_traffic_filtering=True,id=970d841b-bbfc-409e-8ec5-ddbea8be8c5d,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970d841b-bb') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.objects.instance [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'pci_devices' on Instance uuid f2a79a44-800e-4142-b778-aae06a5c779d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:08:53 user nova-compute[71516]:   <uuid>f2a79a44-800e-4142-b778-aae06a5c779d</uuid>
Apr 11 23:08:53 user nova-compute[71516]:   <name>instance-0000000f</name>
Apr 11 23:08:53 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:08:53 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:08:53 user nova-compute[71516]:   <metadata>
Apr 11 23:08:53 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:08:53 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:08:53 user nova-compute[71516]:       <nova:name>tempest-AttachVolumeNegativeTest-server-294909853</nova:name>
Apr 11 23:08:53 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:08:53</nova:creationTime>
Apr 11 23:08:53 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:08:53 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:08:53 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:08:53 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:08:53 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:08:53 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:08:53 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:08:53 user nova-compute[71516]:       <nova:owner>
Apr 11 23:08:53 user nova-compute[71516]:         <nova:user uuid="da1389f3e27f49f394598636d041a9c9">tempest-AttachVolumeNegativeTest-2123485934-project-member</nova:user>
Apr 11 23:08:53 user nova-compute[71516]:         <nova:project uuid="9f29d28c472c4f65b8437ce443d208c7">tempest-AttachVolumeNegativeTest-2123485934</nova:project>
Apr 11 23:08:53 user nova-compute[71516]:       </nova:owner>
Apr 11 23:08:53 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:08:53 user nova-compute[71516]:       <nova:ports>
Apr 11 23:08:53 user nova-compute[71516]:         <nova:port uuid="970d841b-bbfc-409e-8ec5-ddbea8be8c5d">
Apr 11 23:08:53 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 23:08:53 user nova-compute[71516]:         </nova:port>
Apr 11 23:08:53 user nova-compute[71516]:       </nova:ports>
Apr 11 23:08:53 user nova-compute[71516]:     </nova:instance>
Apr 11 23:08:53 user nova-compute[71516]:   </metadata>
Apr 11 23:08:53 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:08:53 user nova-compute[71516]:     <system>
Apr 11 23:08:53 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:08:53 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:08:53 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:08:53 user nova-compute[71516]:       <entry name="serial">f2a79a44-800e-4142-b778-aae06a5c779d</entry>
Apr 11 23:08:53 user nova-compute[71516]:       <entry name="uuid">f2a79a44-800e-4142-b778-aae06a5c779d</entry>
Apr 11 23:08:53 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:08:53 user nova-compute[71516]:     </system>
Apr 11 23:08:53 user nova-compute[71516]:   </sysinfo>
Apr 11 23:08:53 user nova-compute[71516]:   <os>
Apr 11 23:08:53 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:08:53 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:08:53 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:08:53 user nova-compute[71516]:   </os>
Apr 11 23:08:53 user nova-compute[71516]:   <features>
Apr 11 23:08:53 user nova-compute[71516]:     <acpi/>
Apr 11 23:08:53 user nova-compute[71516]:     <apic/>
Apr 11 23:08:53 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:08:53 user nova-compute[71516]:   </features>
Apr 11 23:08:53 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:08:53 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:08:53 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:08:53 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:08:53 user nova-compute[71516]:   </clock>
Apr 11 23:08:53 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:08:53 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:08:53 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:08:53 user nova-compute[71516]:   </cpu>
Apr 11 23:08:53 user nova-compute[71516]:   <devices>
Apr 11 23:08:53 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:08:53 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:08:53 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk"/>
Apr 11 23:08:53 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:08:53 user nova-compute[71516]:     </disk>
Apr 11 23:08:53 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:08:53 user nova-compute[71516]:       <mac address="fa:16:3e:16:12:b6"/>
Apr 11 23:08:53 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:08:53 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:08:53 user nova-compute[71516]:       <target dev="tap970d841b-bb"/>
Apr 11 23:08:53 user nova-compute[71516]:     </interface>
Apr 11 23:08:53 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:08:53 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/console.log" append="off"/>
Apr 11 23:08:53 user nova-compute[71516]:     </serial>
Apr 11 23:08:53 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:08:53 user nova-compute[71516]:     <video>
Apr 11 23:08:53 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:08:53 user nova-compute[71516]:     </video>
Apr 11 23:08:53 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:08:53 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:08:53 user nova-compute[71516]:     </rng>
Apr 11 23:08:53 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:08:53 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:08:53 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:08:53 user nova-compute[71516]:     </memballoon>
Apr 11 23:08:53 user nova-compute[71516]:   </devices>
Apr 11 23:08:53 user nova-compute[71516]: </domain>
Apr 11 23:08:53 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-294909853',display_name='tempest-AttachVolumeNegativeTest-server-294909853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-294909853',id=15,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0zqkr5JslO5pazVYnbydw15T9EjvLg2GhWoOpKqa/Wjsgfn0KXK0Lu5zOBrtqyynlBKK+TPkpstQuZbuDS46amji1YuAoDEopw7Gf9EJdnvh6SOK92JvEf778W3uX0Dg==',key_name='tempest-keypair-1101679830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f29d28c472c4f65b8437ce443d208c7',ramdisk_id='',reservation_id='r-dfiig29j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2123485934',owner_user_name='tempest-AttachVolumeNegativeTest-2123485934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da1389f3e27f49f394598636d041a9c9',uuid=f2a79a44-800e-4142-b778-aae06a5c779d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "address": "fa:16:3e:16:12:b6", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970d841b-bb", "ovs_interfaceid": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converting VIF {"id": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "address": "fa:16:3e:16:12:b6", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970d841b-bb", "ovs_interfaceid": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:12:b6,bridge_name='br-int',has_traffic_filtering=True,id=970d841b-bbfc-409e-8ec5-ddbea8be8c5d,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970d841b-bb') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG os_vif [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:12:b6,bridge_name='br-int',has_traffic_filtering=True,id=970d841b-bbfc-409e-8ec5-ddbea8be8c5d,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970d841b-bb') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap970d841b-bb, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap970d841b-bb, col_values=(('external_ids', {'iface-id': '970d841b-bbfc-409e-8ec5-ddbea8be8c5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:12:b6', 'vm-uuid': 'f2a79a44-800e-4142-b778-aae06a5c779d'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:53 user nova-compute[71516]: INFO os_vif [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:12:b6,bridge_name='br-int',has_traffic_filtering=True,id=970d841b-bbfc-409e-8ec5-ddbea8be8c5d,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970d841b-bb')
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No VIF found with MAC fa:16:3e:16:12:b6, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.neutron [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Successfully updated port: ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquired lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.neutron [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '26564636636303531', 'path': '/dev/sde'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564636636303531', 'path': '/dev/sde'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-742046125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-742046125',id=4,image_ref='1e2d8073-da39-4d01-8111-69c226b39850',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-208393987',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b466a7e141a247319eae64ab30aca760',ramdisk_id='',reservation_id='r-kxb0ie0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849897654',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849897654-project-member',shelved_at='2023-04-11T23:06:50.309455',shelved_host='user',shelved_image_id='1e2d8073-da39-4d01-8111-69c226b39850'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:08:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7272af33be864737b2231127f4323638',uuid=8322b884-2831-48af-a67e-26c31c17f49f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converting VIF {"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'pci_devices' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.neutron [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:08:54 user nova-compute[71516]:   <uuid>8322b884-2831-48af-a67e-26c31c17f49f</uuid>
Apr 11 23:08:54 user nova-compute[71516]:   <name>instance-00000004</name>
Apr 11 23:08:54 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:08:54 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:08:54 user nova-compute[71516]:   <metadata>
Apr 11 23:08:54 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:08:54 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:08:54 user nova-compute[71516]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-742046125</nova:name>
Apr 11 23:08:54 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:08:52</nova:creationTime>
Apr 11 23:08:54 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:08:54 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:08:54 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:08:54 user nova-compute[71516]:       <nova:owner>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:user uuid="7272af33be864737b2231127f4323638">tempest-AttachVolumeShelveTestJSON-1849897654-project-member</nova:user>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:project uuid="b466a7e141a247319eae64ab30aca760">tempest-AttachVolumeShelveTestJSON-1849897654</nova:project>
Apr 11 23:08:54 user nova-compute[71516]:       </nova:owner>
Apr 11 23:08:54 user nova-compute[71516]:       <nova:root type="image" uuid="1e2d8073-da39-4d01-8111-69c226b39850"/>
Apr 11 23:08:54 user nova-compute[71516]:       <nova:ports>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:port uuid="b44a27e4-9811-4e81-8f41-c7f58def46bc">
Apr 11 23:08:54 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:08:54 user nova-compute[71516]:         </nova:port>
Apr 11 23:08:54 user nova-compute[71516]:       </nova:ports>
Apr 11 23:08:54 user nova-compute[71516]:     </nova:instance>
Apr 11 23:08:54 user nova-compute[71516]:   </metadata>
Apr 11 23:08:54 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:08:54 user nova-compute[71516]:     <system>
Apr 11 23:08:54 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:08:54 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:08:54 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:08:54 user nova-compute[71516]:       <entry name="serial">8322b884-2831-48af-a67e-26c31c17f49f</entry>
Apr 11 23:08:54 user nova-compute[71516]:       <entry name="uuid">8322b884-2831-48af-a67e-26c31c17f49f</entry>
Apr 11 23:08:54 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:08:54 user nova-compute[71516]:     </system>
Apr 11 23:08:54 user nova-compute[71516]:   </sysinfo>
Apr 11 23:08:54 user nova-compute[71516]:   <os>
Apr 11 23:08:54 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:08:54 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:08:54 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:08:54 user nova-compute[71516]:   </os>
Apr 11 23:08:54 user nova-compute[71516]:   <features>
Apr 11 23:08:54 user nova-compute[71516]:     <acpi/>
Apr 11 23:08:54 user nova-compute[71516]:     <apic/>
Apr 11 23:08:54 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:08:54 user nova-compute[71516]:   </features>
Apr 11 23:08:54 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:08:54 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:08:54 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:08:54 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:08:54 user nova-compute[71516]:   </clock>
Apr 11 23:08:54 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:08:54 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:08:54 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:08:54 user nova-compute[71516]:   </cpu>
Apr 11 23:08:54 user nova-compute[71516]:   <devices>
Apr 11 23:08:54 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:08:54 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:08:54 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk"/>
Apr 11 23:08:54 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:08:54 user nova-compute[71516]:     </disk>
Apr 11 23:08:54 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:08:54 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:08:54 user nova-compute[71516]:       <source dev="/dev/sde"/>
Apr 11 23:08:54 user nova-compute[71516]:       <target dev="vdc" bus="virtio"/>
Apr 11 23:08:54 user nova-compute[71516]:       <serial>12247dde-59fb-47e6-b624-bc8b349687a0</serial>
Apr 11 23:08:54 user nova-compute[71516]:     </disk>
Apr 11 23:08:54 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:08:54 user nova-compute[71516]:       <mac address="fa:16:3e:6a:ca:ec"/>
Apr 11 23:08:54 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:08:54 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:08:54 user nova-compute[71516]:       <target dev="tapb44a27e4-98"/>
Apr 11 23:08:54 user nova-compute[71516]:     </interface>
Apr 11 23:08:54 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:08:54 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/console.log" append="off"/>
Apr 11 23:08:54 user nova-compute[71516]:     </serial>
Apr 11 23:08:54 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:08:54 user nova-compute[71516]:     <video>
Apr 11 23:08:54 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:08:54 user nova-compute[71516]:     </video>
Apr 11 23:08:54 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:08:54 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:08:54 user nova-compute[71516]:     </rng>
Apr 11 23:08:54 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:08:54 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:08:54 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:08:54 user nova-compute[71516]:     </memballoon>
Apr 11 23:08:54 user nova-compute[71516]:   </devices>
Apr 11 23:08:54 user nova-compute[71516]: </domain>
Apr 11 23:08:54 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-742046125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-742046125',id=4,image_ref='1e2d8073-da39-4d01-8111-69c226b39850',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-208393987',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b466a7e141a247319eae64ab30aca760',ramdisk_id='',reservation_id='r-kxb0ie0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849897654',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849897654-project-member',shelved_at='2023-04-11T23:06:50.309455',shelved_host='user',shelved_image_id='1e2d8073-da39-4d01-8111-69c226b39850'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:08:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7272af33be864737b2231127f4323638',uuid=8322b884-2831-48af-a67e-26c31c17f49f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converting VIF {"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG os_vif [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb44a27e4-98, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb44a27e4-98, col_values=(('external_ids', {'iface-id': 'b44a27e4-9811-4e81-8f41-c7f58def46bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:ca:ec', 'vm-uuid': '8322b884-2831-48af-a67e-26c31c17f49f'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:54 user nova-compute[71516]: INFO os_vif [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98')
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] No VIF found with MAC fa:16:3e:6a:ca:ec, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.neutron [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Updated VIF entry in instance network info cache for port 970d841b-bbfc-409e-8ec5-ddbea8be8c5d. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.neutron [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Updating instance_info_cache with network_info: [{"id": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "address": "fa:16:3e:16:12:b6", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970d841b-bb", "ovs_interfaceid": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] Releasing lock "refresh_cache-f2a79a44-800e-4142-b778-aae06a5c779d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.neutron [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Updating instance_info_cache with network_info: [{"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Releasing lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.compute.manager [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Instance network_info: |[{"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Start _get_guest_xml network_info=[{"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:08:54 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:08:54 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-306537180',display_name='tempest-AttachVolumeTestJSON-server-306537180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-306537180',id=16,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBCZV7mfgey8l84oWxyLPmpf/vUdIecbJfbZusGcLaLsUyVaAO/eUu8uumuNjaCqYf3u0A6YOPq2RC4XZqaH6cL8LKWE4mILFzbc1EBe4QFoOM0qAj4Mr6qKrIzOcb4DQ==',key_name='tempest-keypair-759307061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0ff3d48596a44f8ac8d9306becd8178',ramdisk_id='',reservation_id='r-75uy56ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-343820803',owner_user_name='tempest-AttachVolumeTestJSON-343820803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1793cec543e8425899474614b2c10f5d',uuid=e4d31874-4273-48bc-8811-89832d18b893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converting VIF {"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.objects.instance [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'pci_devices' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:08:54 user nova-compute[71516]:   <uuid>e4d31874-4273-48bc-8811-89832d18b893</uuid>
Apr 11 23:08:54 user nova-compute[71516]:   <name>instance-00000010</name>
Apr 11 23:08:54 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:08:54 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:08:54 user nova-compute[71516]:   <metadata>
Apr 11 23:08:54 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:08:54 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:08:54 user nova-compute[71516]:       <nova:name>tempest-AttachVolumeTestJSON-server-306537180</nova:name>
Apr 11 23:08:54 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:08:54</nova:creationTime>
Apr 11 23:08:54 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:08:54 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:08:54 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:08:54 user nova-compute[71516]:       <nova:owner>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:user uuid="1793cec543e8425899474614b2c10f5d">tempest-AttachVolumeTestJSON-343820803-project-member</nova:user>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:project uuid="f0ff3d48596a44f8ac8d9306becd8178">tempest-AttachVolumeTestJSON-343820803</nova:project>
Apr 11 23:08:54 user nova-compute[71516]:       </nova:owner>
Apr 11 23:08:54 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:08:54 user nova-compute[71516]:       <nova:ports>
Apr 11 23:08:54 user nova-compute[71516]:         <nova:port uuid="ac90e400-803b-41b5-b183-f93bfbf297b6">
Apr 11 23:08:54 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 23:08:54 user nova-compute[71516]:         </nova:port>
Apr 11 23:08:54 user nova-compute[71516]:       </nova:ports>
Apr 11 23:08:54 user nova-compute[71516]:     </nova:instance>
Apr 11 23:08:54 user nova-compute[71516]:   </metadata>
Apr 11 23:08:54 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:08:54 user nova-compute[71516]:     <system>
Apr 11 23:08:54 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:08:54 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:08:54 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:08:54 user nova-compute[71516]:       <entry name="serial">e4d31874-4273-48bc-8811-89832d18b893</entry>
Apr 11 23:08:54 user nova-compute[71516]:       <entry name="uuid">e4d31874-4273-48bc-8811-89832d18b893</entry>
Apr 11 23:08:54 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:08:54 user nova-compute[71516]:     </system>
Apr 11 23:08:54 user nova-compute[71516]:   </sysinfo>
Apr 11 23:08:54 user nova-compute[71516]:   <os>
Apr 11 23:08:54 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:08:54 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:08:54 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:08:54 user nova-compute[71516]:   </os>
Apr 11 23:08:54 user nova-compute[71516]:   <features>
Apr 11 23:08:54 user nova-compute[71516]:     <acpi/>
Apr 11 23:08:54 user nova-compute[71516]:     <apic/>
Apr 11 23:08:54 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:08:54 user nova-compute[71516]:   </features>
Apr 11 23:08:54 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:08:54 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:08:54 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:08:54 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:08:54 user nova-compute[71516]:   </clock>
Apr 11 23:08:54 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:08:54 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:08:54 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:08:54 user nova-compute[71516]:   </cpu>
Apr 11 23:08:54 user nova-compute[71516]:   <devices>
Apr 11 23:08:54 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:08:54 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:08:54 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk"/>
Apr 11 23:08:54 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:08:54 user nova-compute[71516]:     </disk>
Apr 11 23:08:54 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:08:54 user nova-compute[71516]:       <mac address="fa:16:3e:f7:1e:78"/>
Apr 11 23:08:54 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:08:54 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:08:54 user nova-compute[71516]:       <target dev="tapac90e400-80"/>
Apr 11 23:08:54 user nova-compute[71516]:     </interface>
Apr 11 23:08:54 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:08:54 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/console.log" append="off"/>
Apr 11 23:08:54 user nova-compute[71516]:     </serial>
Apr 11 23:08:54 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:08:54 user nova-compute[71516]:     <video>
Apr 11 23:08:54 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:08:54 user nova-compute[71516]:     </video>
Apr 11 23:08:54 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:08:54 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:08:54 user nova-compute[71516]:     </rng>
Apr 11 23:08:54 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:08:54 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:08:54 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:08:54 user nova-compute[71516]:     </memballoon>
Apr 11 23:08:54 user nova-compute[71516]:   </devices>
Apr 11 23:08:54 user nova-compute[71516]: </domain>
Apr 11 23:08:54 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-306537180',display_name='tempest-AttachVolumeTestJSON-server-306537180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-306537180',id=16,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBCZV7mfgey8l84oWxyLPmpf/vUdIecbJfbZusGcLaLsUyVaAO/eUu8uumuNjaCqYf3u0A6YOPq2RC4XZqaH6cL8LKWE4mILFzbc1EBe4QFoOM0qAj4Mr6qKrIzOcb4DQ==',key_name='tempest-keypair-759307061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0ff3d48596a44f8ac8d9306becd8178',ramdisk_id='',reservation_id='r-75uy56ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-343820803',owner_user_name='tempest-AttachVolumeTestJSON-343820803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1793cec543e8425899474614b2c10f5d',uuid=e4d31874-4273-48bc-8811-89832d18b893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converting VIF {"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG os_vif [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac90e400-80, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac90e400-80, col_values=(('external_ids', {'iface-id': 'ac90e400-803b-41b5-b183-f93bfbf297b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:1e:78', 'vm-uuid': 'e4d31874-4273-48bc-8811-89832d18b893'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:54 user nova-compute[71516]: INFO os_vif [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80')
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:08:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No VIF found with MAC fa:16:3e:f7:1e:78, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-changed-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Refreshing instance network info cache due to event network-changed-ac90e400-803b-41b5-b183-f93bfbf297b6. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] Acquiring lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] Acquired lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.network.neutron [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Refreshing network info cache for port ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.network.neutron [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Updated VIF entry in instance network info cache for port ac90e400-803b-41b5-b183-f93bfbf297b6. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.network.neutron [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Updating instance_info_cache with network_info: [{"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for eed8cea5-9e5c-4467-8993-456cb3235fd8 due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254535.537228, eed8cea5-9e5c-4467-8993-456cb3235fd8 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:08:55 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] VM Resumed (Lifecycle Event)
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] Releasing lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:08:55 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance spawned successfully.
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:08:55 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254535.5440218, eed8cea5-9e5c-4467-8993-456cb3235fd8 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:08:55 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] VM Started (Lifecycle Event)
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:08:55 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-2c025939-07c4-462b-b6e8-46a224af4f80 req-e120000b-de1c-4f99-ac3b-1516ce01636e service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2c025939-07c4-462b-b6e8-46a224af4f80 req-e120000b-de1c-4f99-ac3b-1516ce01636e service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2c025939-07c4-462b-b6e8-46a224af4f80 req-e120000b-de1c-4f99-ac3b-1516ce01636e service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2c025939-07c4-462b-b6e8-46a224af4f80 req-e120000b-de1c-4f99-ac3b-1516ce01636e service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-2c025939-07c4-462b-b6e8-46a224af4f80 req-e120000b-de1c-4f99-ac3b-1516ce01636e service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:55 user nova-compute[71516]: WARNING nova.compute.manager [req-2c025939-07c4-462b-b6e8-46a224af4f80 req-e120000b-de1c-4f99-ac3b-1516ce01636e service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state active and task_state rebuild_spawning.
Apr 11 23:08:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG nova.objects.instance [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71516) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 23:08:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-b97cea28-8f27-45ba-82f2-653d961bd025 req-50ba71fe-1c96-42a8-95ba-ddafc7ca2ad7 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Received event network-vif-plugged-970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b97cea28-8f27-45ba-82f2-653d961bd025 req-50ba71fe-1c96-42a8-95ba-ddafc7ca2ad7 service nova] Acquiring lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b97cea28-8f27-45ba-82f2-653d961bd025 req-50ba71fe-1c96-42a8-95ba-ddafc7ca2ad7 service nova] Lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b97cea28-8f27-45ba-82f2-653d961bd025 req-50ba71fe-1c96-42a8-95ba-ddafc7ca2ad7 service nova] Lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-b97cea28-8f27-45ba-82f2-653d961bd025 req-50ba71fe-1c96-42a8-95ba-ddafc7ca2ad7 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] No waiting events found dispatching network-vif-plugged-970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:57 user nova-compute[71516]: WARNING nova.compute.manager [req-b97cea28-8f27-45ba-82f2-653d961bd025 req-50ba71fe-1c96-42a8-95ba-ddafc7ca2ad7 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Received unexpected event network-vif-plugged-970d841b-bbfc-409e-8ec5-ddbea8be8c5d for instance with vm_state building and task_state spawning.
Apr 11 23:08:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-f0cb14f3-4277-4480-becf-9fcfc7b80050 req-8bbe570f-c535-4e0b-a2a6-8d4f063b2006 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f0cb14f3-4277-4480-becf-9fcfc7b80050 req-8bbe570f-c535-4e0b-a2a6-8d4f063b2006 service nova] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f0cb14f3-4277-4480-becf-9fcfc7b80050 req-8bbe570f-c535-4e0b-a2a6-8d4f063b2006 service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f0cb14f3-4277-4480-becf-9fcfc7b80050 req-8bbe570f-c535-4e0b-a2a6-8d4f063b2006 service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-f0cb14f3-4277-4480-becf-9fcfc7b80050 req-8bbe570f-c535-4e0b-a2a6-8d4f063b2006 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] No waiting events found dispatching network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:57 user nova-compute[71516]: WARNING nova.compute.manager [req-f0cb14f3-4277-4480-becf-9fcfc7b80050 req-8bbe570f-c535-4e0b-a2a6-8d4f063b2006 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received unexpected event network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 23:08:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Received event network-vif-plugged-970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Acquiring lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] No waiting events found dispatching network-vif-plugged-970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:59 user nova-compute[71516]: WARNING nova.compute.manager [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Received unexpected event network-vif-plugged-970d841b-bbfc-409e-8ec5-ddbea8be8c5d for instance with vm_state building and task_state spawning.
Apr 11 23:08:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] No waiting events found dispatching network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:59 user nova-compute[71516]: WARNING nova.compute.manager [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received unexpected event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 for instance with vm_state building and task_state spawning.
Apr 11 23:08:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] No waiting events found dispatching network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:59 user nova-compute[71516]: WARNING nova.compute.manager [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received unexpected event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 for instance with vm_state building and task_state spawning.
Apr 11 23:08:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-4022bbc7-dc44-4c70-b1ef-fce2ac1470d0 req-138ab377-fa87-40a1-b625-1f47fc209bce service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4022bbc7-dc44-4c70-b1ef-fce2ac1470d0 req-138ab377-fa87-40a1-b625-1f47fc209bce service nova] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4022bbc7-dc44-4c70-b1ef-fce2ac1470d0 req-138ab377-fa87-40a1-b625-1f47fc209bce service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4022bbc7-dc44-4c70-b1ef-fce2ac1470d0 req-138ab377-fa87-40a1-b625-1f47fc209bce service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:08:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-4022bbc7-dc44-4c70-b1ef-fce2ac1470d0 req-138ab377-fa87-40a1-b625-1f47fc209bce service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] No waiting events found dispatching network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:08:59 user nova-compute[71516]: WARNING nova.compute.manager [req-4022bbc7-dc44-4c70-b1ef-fce2ac1470d0 req-138ab377-fa87-40a1-b625-1f47fc209bce service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received unexpected event network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 23:09:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254541.35933, f2a79a44-800e-4142-b778-aae06a5c779d => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] VM Resumed (Lifecycle Event)
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Instance spawned successfully.
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254541.3663015, f2a79a44-800e-4142-b778-aae06a5c779d => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] VM Started (Lifecycle Event)
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254541.5066757, 8322b884-2831-48af-a67e-26c31c17f49f => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] VM Resumed (Lifecycle Event)
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Instance spawned successfully.
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] Instance spawned successfully.
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Took 11.41 seconds to spawn the instance on the hypervisor.
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254541.50681, 8322b884-2831-48af-a67e-26c31c17f49f => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] VM Started (Lifecycle Event)
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254541.575086, e4d31874-4273-48bc-8811-89832d18b893 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] VM Resumed (Lifecycle Event)
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Took 13.46 seconds to build instance.
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254541.578647, e4d31874-4273-48bc-8811-89832d18b893 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] VM Started (Lifecycle Event)
Apr 11 23:09:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2a79a44-800e-4142-b778-aae06a5c779d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.616s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Took 10.75 seconds to spawn the instance on the hypervisor.
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:09:01 user nova-compute[71516]: INFO nova.compute.manager [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Took 12.36 seconds to build instance.
Apr 11 23:09:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "8322b884-2831-48af-a67e-26c31c17f49f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.009s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.598s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:09:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:26 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:09:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:09:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:09:27 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:09:27 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:09:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:09:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:28 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:09:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:09:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:31 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:09:31 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:09:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=7587MB free_disk=26.323169708251953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:09:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 4f95b120-0c70-45a5-969f-c1728c72d420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 04b926fc-370b-485a-ad51-944ba0791ebb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 8322b884-2831-48af-a67e-26c31c17f49f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f2a79a44-800e-4142-b778-aae06a5c779d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e4d31874-4273-48bc-8811-89832d18b893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:09:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:09:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:09:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:09:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:09:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "a95ec17c-3200-4f51-be89-116ee3306968" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "a95ec17c-3200-4f51-be89-116ee3306968" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:09:34 user nova-compute[71516]: INFO nova.compute.claims [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Claim successful on node user
Apr 11 23:09:34 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:09:34 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:09:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG nova.policy [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '190187c84d9a42e4a6f6e2a834cae8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2b607b5736495895de9c423eeb7443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:09:34 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Creating image(s)
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "/opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "/opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "/opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.130s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk 1073741824" returned: 0 in 0.049s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.163s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Successfully created port: e40ede4c-bd9e-4e65-bc15-6320fcd5134a {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Cannot resize image /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lazy-loading 'migration_context' on Instance uuid a95ec17c-3200-4f51-be89-116ee3306968 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Ensure instance console log exists: /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Successfully updated port: e40ede4c-bd9e-4e65-bc15-6320fcd5134a {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "refresh_cache-a95ec17c-3200-4f51-be89-116ee3306968" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquired lock "refresh_cache-a95ec17c-3200-4f51-be89-116ee3306968" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:09:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Received event network-changed-e40ede4c-bd9e-4e65-bc15-6320fcd5134a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Refreshing instance network info cache due to event network-changed-e40ede4c-bd9e-4e65-bc15-6320fcd5134a. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] Acquiring lock "refresh_cache-a95ec17c-3200-4f51-be89-116ee3306968" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Updating instance_info_cache with network_info: [{"id": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "address": "fa:16:3e:d4:7a:63", "network": {"id": "3b8208aa-b1fb-4696-a19a-fde2229542d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-687348258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b607b5736495895de9c423eeb7443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape40ede4c-bd", "ovs_interfaceid": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Releasing lock "refresh_cache-a95ec17c-3200-4f51-be89-116ee3306968" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Instance network_info: |[{"id": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "address": "fa:16:3e:d4:7a:63", "network": {"id": "3b8208aa-b1fb-4696-a19a-fde2229542d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-687348258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b607b5736495895de9c423eeb7443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape40ede4c-bd", "ovs_interfaceid": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] Acquired lock "refresh_cache-a95ec17c-3200-4f51-be89-116ee3306968" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Refreshing network info cache for port e40ede4c-bd9e-4e65-bc15-6320fcd5134a {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Start _get_guest_xml network_info=[{"id": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "address": "fa:16:3e:d4:7a:63", "network": {"id": "3b8208aa-b1fb-4696-a19a-fde2229542d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-687348258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b607b5736495895de9c423eeb7443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape40ede4c-bd", "ovs_interfaceid": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:09:36 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:09:36 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1735343577',display_name='tempest-DeleteServersTestJSON-server-1735343577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1735343577',id=17,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db2b607b5736495895de9c423eeb7443',ramdisk_id='',reservation_id='r-f62sbttp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1854468270',owner_user_name='tempest-DeleteServersTestJSON-1854468270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:09:35Z,user_data=None,user_id='190187c84d9a42e4a6f6e2a834cae8eb',uuid=a95ec17c-3200-4f51-be89-116ee3306968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "address": "fa:16:3e:d4:7a:63", "network": {"id": "3b8208aa-b1fb-4696-a19a-fde2229542d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-687348258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b607b5736495895de9c423eeb7443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape40ede4c-bd", "ovs_interfaceid": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Converting VIF {"id": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "address": "fa:16:3e:d4:7a:63", "network": {"id": "3b8208aa-b1fb-4696-a19a-fde2229542d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-687348258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b607b5736495895de9c423eeb7443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape40ede4c-bd", "ovs_interfaceid": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=e40ede4c-bd9e-4e65-bc15-6320fcd5134a,network=Network(3b8208aa-b1fb-4696-a19a-fde2229542d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40ede4c-bd') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lazy-loading 'pci_devices' on Instance uuid a95ec17c-3200-4f51-be89-116ee3306968 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:09:36 user nova-compute[71516]:   <uuid>a95ec17c-3200-4f51-be89-116ee3306968</uuid>
Apr 11 23:09:36 user nova-compute[71516]:   <name>instance-00000011</name>
Apr 11 23:09:36 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:09:36 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:09:36 user nova-compute[71516]:   <metadata>
Apr 11 23:09:36 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:09:36 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:09:36 user nova-compute[71516]:       <nova:name>tempest-DeleteServersTestJSON-server-1735343577</nova:name>
Apr 11 23:09:36 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:09:36</nova:creationTime>
Apr 11 23:09:36 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:09:36 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:09:36 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:09:36 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:09:36 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:09:36 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:09:36 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:09:36 user nova-compute[71516]:       <nova:owner>
Apr 11 23:09:36 user nova-compute[71516]:         <nova:user uuid="190187c84d9a42e4a6f6e2a834cae8eb">tempest-DeleteServersTestJSON-1854468270-project-member</nova:user>
Apr 11 23:09:36 user nova-compute[71516]:         <nova:project uuid="db2b607b5736495895de9c423eeb7443">tempest-DeleteServersTestJSON-1854468270</nova:project>
Apr 11 23:09:36 user nova-compute[71516]:       </nova:owner>
Apr 11 23:09:36 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:09:36 user nova-compute[71516]:       <nova:ports>
Apr 11 23:09:36 user nova-compute[71516]:         <nova:port uuid="e40ede4c-bd9e-4e65-bc15-6320fcd5134a">
Apr 11 23:09:36 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 23:09:36 user nova-compute[71516]:         </nova:port>
Apr 11 23:09:36 user nova-compute[71516]:       </nova:ports>
Apr 11 23:09:36 user nova-compute[71516]:     </nova:instance>
Apr 11 23:09:36 user nova-compute[71516]:   </metadata>
Apr 11 23:09:36 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:09:36 user nova-compute[71516]:     <system>
Apr 11 23:09:36 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:09:36 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:09:36 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:09:36 user nova-compute[71516]:       <entry name="serial">a95ec17c-3200-4f51-be89-116ee3306968</entry>
Apr 11 23:09:36 user nova-compute[71516]:       <entry name="uuid">a95ec17c-3200-4f51-be89-116ee3306968</entry>
Apr 11 23:09:36 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:09:36 user nova-compute[71516]:     </system>
Apr 11 23:09:36 user nova-compute[71516]:   </sysinfo>
Apr 11 23:09:36 user nova-compute[71516]:   <os>
Apr 11 23:09:36 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:09:36 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:09:36 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:09:36 user nova-compute[71516]:   </os>
Apr 11 23:09:36 user nova-compute[71516]:   <features>
Apr 11 23:09:36 user nova-compute[71516]:     <acpi/>
Apr 11 23:09:36 user nova-compute[71516]:     <apic/>
Apr 11 23:09:36 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:09:36 user nova-compute[71516]:   </features>
Apr 11 23:09:36 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:09:36 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:09:36 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:09:36 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:09:36 user nova-compute[71516]:   </clock>
Apr 11 23:09:36 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:09:36 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:09:36 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:09:36 user nova-compute[71516]:   </cpu>
Apr 11 23:09:36 user nova-compute[71516]:   <devices>
Apr 11 23:09:36 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:09:36 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:09:36 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk"/>
Apr 11 23:09:36 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:09:36 user nova-compute[71516]:     </disk>
Apr 11 23:09:36 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:09:36 user nova-compute[71516]:       <mac address="fa:16:3e:d4:7a:63"/>
Apr 11 23:09:36 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:09:36 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:09:36 user nova-compute[71516]:       <target dev="tape40ede4c-bd"/>
Apr 11 23:09:36 user nova-compute[71516]:     </interface>
Apr 11 23:09:36 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:09:36 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/console.log" append="off"/>
Apr 11 23:09:36 user nova-compute[71516]:     </serial>
Apr 11 23:09:36 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:09:36 user nova-compute[71516]:     <video>
Apr 11 23:09:36 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:09:36 user nova-compute[71516]:     </video>
Apr 11 23:09:36 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:09:36 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:09:36 user nova-compute[71516]:     </rng>
Apr 11 23:09:36 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:09:36 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:09:36 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:09:36 user nova-compute[71516]:     </memballoon>
Apr 11 23:09:36 user nova-compute[71516]:   </devices>
Apr 11 23:09:36 user nova-compute[71516]: </domain>
Apr 11 23:09:36 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1735343577',display_name='tempest-DeleteServersTestJSON-server-1735343577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1735343577',id=17,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db2b607b5736495895de9c423eeb7443',ramdisk_id='',reservation_id='r-f62sbttp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1854468270',owner_user_name='tempest-DeleteServersTestJSON-1854468270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:09:35Z,user_data=None,user_id='190187c84d9a42e4a6f6e2a834cae8eb',uuid=a95ec17c-3200-4f51-be89-116ee3306968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "address": "fa:16:3e:d4:7a:63", "network": {"id": "3b8208aa-b1fb-4696-a19a-fde2229542d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-687348258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b607b5736495895de9c423eeb7443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape40ede4c-bd", "ovs_interfaceid": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Converting VIF {"id": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "address": "fa:16:3e:d4:7a:63", "network": {"id": "3b8208aa-b1fb-4696-a19a-fde2229542d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-687348258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b607b5736495895de9c423eeb7443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape40ede4c-bd", "ovs_interfaceid": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=e40ede4c-bd9e-4e65-bc15-6320fcd5134a,network=Network(3b8208aa-b1fb-4696-a19a-fde2229542d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40ede4c-bd') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG os_vif [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=e40ede4c-bd9e-4e65-bc15-6320fcd5134a,network=Network(3b8208aa-b1fb-4696-a19a-fde2229542d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40ede4c-bd') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape40ede4c-bd, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape40ede4c-bd, col_values=(('external_ids', {'iface-id': 'e40ede4c-bd9e-4e65-bc15-6320fcd5134a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:7a:63', 'vm-uuid': 'a95ec17c-3200-4f51-be89-116ee3306968'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:36 user nova-compute[71516]: INFO os_vif [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=e40ede4c-bd9e-4e65-bc15-6320fcd5134a,network=Network(3b8208aa-b1fb-4696-a19a-fde2229542d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40ede4c-bd')
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:09:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] No VIF found with MAC fa:16:3e:d4:7a:63, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:09:37 user nova-compute[71516]: DEBUG nova.network.neutron [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Updated VIF entry in instance network info cache for port e40ede4c-bd9e-4e65-bc15-6320fcd5134a. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:09:37 user nova-compute[71516]: DEBUG nova.network.neutron [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Updating instance_info_cache with network_info: [{"id": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "address": "fa:16:3e:d4:7a:63", "network": {"id": "3b8208aa-b1fb-4696-a19a-fde2229542d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-687348258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b607b5736495895de9c423eeb7443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape40ede4c-bd", "ovs_interfaceid": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:09:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] Releasing lock "refresh_cache-a95ec17c-3200-4f51-be89-116ee3306968" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:09:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-361d41f1-a1a2-4da9-b258-089f3ffd455b req-d652d536-9ae9-4ede-aa5e-1a79fcb50701 service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Received event network-vif-plugged-e40ede4c-bd9e-4e65-bc15-6320fcd5134a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:09:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-361d41f1-a1a2-4da9-b258-089f3ffd455b req-d652d536-9ae9-4ede-aa5e-1a79fcb50701 service nova] Acquiring lock "a95ec17c-3200-4f51-be89-116ee3306968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-361d41f1-a1a2-4da9-b258-089f3ffd455b req-d652d536-9ae9-4ede-aa5e-1a79fcb50701 service nova] Lock "a95ec17c-3200-4f51-be89-116ee3306968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-361d41f1-a1a2-4da9-b258-089f3ffd455b req-d652d536-9ae9-4ede-aa5e-1a79fcb50701 service nova] Lock "a95ec17c-3200-4f51-be89-116ee3306968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-361d41f1-a1a2-4da9-b258-089f3ffd455b req-d652d536-9ae9-4ede-aa5e-1a79fcb50701 service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] No waiting events found dispatching network-vif-plugged-e40ede4c-bd9e-4e65-bc15-6320fcd5134a {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:09:38 user nova-compute[71516]: WARNING nova.compute.manager [req-361d41f1-a1a2-4da9-b258-089f3ffd455b req-d652d536-9ae9-4ede-aa5e-1a79fcb50701 service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Received unexpected event network-vif-plugged-e40ede4c-bd9e-4e65-bc15-6320fcd5134a for instance with vm_state building and task_state spawning.
Apr 11 23:09:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.compute.manager [req-b5d093ec-20b0-4ce5-bb36-5de2e80b0bfa req-e46f0a87-01be-42f7-8ea6-d7dee90c6fa7 service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Received event network-vif-plugged-e40ede4c-bd9e-4e65-bc15-6320fcd5134a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b5d093ec-20b0-4ce5-bb36-5de2e80b0bfa req-e46f0a87-01be-42f7-8ea6-d7dee90c6fa7 service nova] Acquiring lock "a95ec17c-3200-4f51-be89-116ee3306968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b5d093ec-20b0-4ce5-bb36-5de2e80b0bfa req-e46f0a87-01be-42f7-8ea6-d7dee90c6fa7 service nova] Lock "a95ec17c-3200-4f51-be89-116ee3306968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b5d093ec-20b0-4ce5-bb36-5de2e80b0bfa req-e46f0a87-01be-42f7-8ea6-d7dee90c6fa7 service nova] Lock "a95ec17c-3200-4f51-be89-116ee3306968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.compute.manager [req-b5d093ec-20b0-4ce5-bb36-5de2e80b0bfa req-e46f0a87-01be-42f7-8ea6-d7dee90c6fa7 service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] No waiting events found dispatching network-vif-plugged-e40ede4c-bd9e-4e65-bc15-6320fcd5134a {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:09:40 user nova-compute[71516]: WARNING nova.compute.manager [req-b5d093ec-20b0-4ce5-bb36-5de2e80b0bfa req-e46f0a87-01be-42f7-8ea6-d7dee90c6fa7 service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Received unexpected event network-vif-plugged-e40ede4c-bd9e-4e65-bc15-6320fcd5134a for instance with vm_state building and task_state spawning.
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254580.6745918, a95ec17c-3200-4f51-be89-116ee3306968 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:09:40 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: a95ec17c-3200-4f51-be89-116ee3306968] VM Resumed (Lifecycle Event)
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:09:40 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Instance spawned successfully.
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:09:40 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: a95ec17c-3200-4f51-be89-116ee3306968] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254580.6760294, a95ec17c-3200-4f51-be89-116ee3306968 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:09:40 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: a95ec17c-3200-4f51-be89-116ee3306968] VM Started (Lifecycle Event)
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:09:40 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: a95ec17c-3200-4f51-be89-116ee3306968] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:09:40 user nova-compute[71516]: INFO nova.compute.manager [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Took 6.16 seconds to spawn the instance on the hypervisor.
Apr 11 23:09:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:09:40 user nova-compute[71516]: INFO nova.compute.manager [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Took 6.86 seconds to build instance.
Apr 11 23:09:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "a95ec17c-3200-4f51-be89-116ee3306968" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.957s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "04b926fc-370b-485a-ad51-944ba0791ebb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "04b926fc-370b-485a-ad51-944ba0791ebb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:48 user nova-compute[71516]: INFO nova.compute.manager [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Terminating instance
Apr 11 23:09:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:09:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG nova.compute.manager [req-1e0e94b2-312d-41c8-9254-ab98056fdbb6 req-3ca251f8-8c3c-43f0-9295-cc0ddf109030 service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Received event network-vif-unplugged-dc4b3a29-90e2-4b93-838d-a01ef7479bfb {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1e0e94b2-312d-41c8-9254-ab98056fdbb6 req-3ca251f8-8c3c-43f0-9295-cc0ddf109030 service nova] Acquiring lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1e0e94b2-312d-41c8-9254-ab98056fdbb6 req-3ca251f8-8c3c-43f0-9295-cc0ddf109030 service nova] Lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1e0e94b2-312d-41c8-9254-ab98056fdbb6 req-3ca251f8-8c3c-43f0-9295-cc0ddf109030 service nova] Lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG nova.compute.manager [req-1e0e94b2-312d-41c8-9254-ab98056fdbb6 req-3ca251f8-8c3c-43f0-9295-cc0ddf109030 service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] No waiting events found dispatching network-vif-unplugged-dc4b3a29-90e2-4b93-838d-a01ef7479bfb {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG nova.compute.manager [req-1e0e94b2-312d-41c8-9254-ab98056fdbb6 req-3ca251f8-8c3c-43f0-9295-cc0ddf109030 service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Received event network-vif-unplugged-dc4b3a29-90e2-4b93-838d-a01ef7479bfb for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:49 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Instance destroyed successfully.
Apr 11 23:09:49 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lazy-loading 'resources' on Instance uuid 04b926fc-370b-485a-ad51-944ba0791ebb {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:07:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-377335540',display_name='tempest-VolumesAdminNegativeTest-server-377335540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-377335540',id=13,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:08:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c24d77b00c084f6f857147717350b6e0',ramdisk_id='',reservation_id='r-dgnj21lw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-497834960',owner_user_name='tempest-VolumesAdminNegativeTest-497834960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:08:01Z,user_data=None,user_id='340848f1de07428e85af2cf660943c3e',uuid=04b926fc-370b-485a-ad51-944ba0791ebb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "address": "fa:16:3e:25:9b:bc", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4b3a29-90", "ovs_interfaceid": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Converting VIF {"id": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "address": "fa:16:3e:25:9b:bc", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4b3a29-90", "ovs_interfaceid": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=dc4b3a29-90e2-4b93-838d-a01ef7479bfb,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4b3a29-90') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG os_vif [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=dc4b3a29-90e2-4b93-838d-a01ef7479bfb,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4b3a29-90') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc4b3a29-90, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:09:49 user nova-compute[71516]: INFO os_vif [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=dc4b3a29-90e2-4b93-838d-a01ef7479bfb,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4b3a29-90')
Apr 11 23:09:49 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Deleting instance files /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb_del
Apr 11 23:09:49 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Deletion of /opt/stack/data/nova/instances/04b926fc-370b-485a-ad51-944ba0791ebb_del complete
Apr 11 23:09:49 user nova-compute[71516]: INFO nova.compute.manager [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Took 0.74 seconds to destroy the instance on the hypervisor.
Apr 11 23:09:49 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:09:49 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:09:50 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:09:50 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Took 0.70 seconds to deallocate network for instance.
Apr 11 23:09:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:50 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:09:50 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:09:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:50 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Deleted allocations for instance 04b926fc-370b-485a-ad51-944ba0791ebb
Apr 11 23:09:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "04b926fc-370b-485a-ad51-944ba0791ebb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.123s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Received event network-vif-plugged-dc4b3a29-90e2-4b93-838d-a01ef7479bfb {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:09:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] Acquiring lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:09:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] Lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:09:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] Lock "04b926fc-370b-485a-ad51-944ba0791ebb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:09:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] No waiting events found dispatching network-vif-plugged-dc4b3a29-90e2-4b93-838d-a01ef7479bfb {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:09:51 user nova-compute[71516]: WARNING nova.compute.manager [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Received unexpected event network-vif-plugged-dc4b3a29-90e2-4b93-838d-a01ef7479bfb for instance with vm_state deleted and task_state None.
Apr 11 23:09:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Received event network-vif-deleted-dc4b3a29-90e2-4b93-838d-a01ef7479bfb {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:09:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:09:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:04 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254589.3884106, 04b926fc-370b-485a-ad51-944ba0791ebb => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:10:04 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] VM Stopped (Lifecycle Event)
Apr 11 23:10:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-37e3c83a-1c10-48f7-b782-5fbe75b1e4e0 None None] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "039fb13b-89bc-493c-af37-9f261ab5c077" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "039fb13b-89bc-493c-af37-9f261ab5c077" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:10:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:09 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:10:09 user nova-compute[71516]: INFO nova.compute.claims [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Claim successful on node user
Apr 11 23:10:09 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:10:09 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:10:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:10:09 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:10:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:10:09 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:10:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:10:10 user nova-compute[71516]: INFO nova.virt.block_device [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Booting with volume snapshot d08dee79-c518-43b4-a83e-3d243a253f4d at /dev/vda
Apr 11 23:10:10 user nova-compute[71516]: DEBUG nova.policy [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:10:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:10:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:10:10 user nova-compute[71516]: INFO nova.compute.claims [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Claim successful on node user
Apr 11 23:10:10 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Successfully created port: 05e7023b-90b4-42fb-a20d-554820d2afea {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.network.neutron [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:10:11 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:10:11 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Creating image(s)
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "/opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "/opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "/opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.policy [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3995d8045154666b0ae890dd3de5ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154fad18f802436d95b15503e470d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.193s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk 1073741824" returned: 0 in 0.050s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Successfully updated port: 05e7023b-90b4-42fb-a20d-554820d2afea {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Received event network-changed-05e7023b-90b4-42fb-a20d-554820d2afea {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Refreshing instance network info cache due to event network-changed-05e7023b-90b4-42fb-a20d-554820d2afea. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] Acquiring lock "refresh_cache-039fb13b-89bc-493c-af37-9f261ab5c077" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] Acquired lock "refresh_cache-039fb13b-89bc-493c-af37-9f261ab5c077" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.network.neutron [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Refreshing network info cache for port 05e7023b-90b4-42fb-a20d-554820d2afea {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "refresh_cache-039fb13b-89bc-493c-af37-9f261ab5c077" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.146s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:10:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG nova.network.neutron [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Cannot resize image /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG nova.objects.instance [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'migration_context' on Instance uuid 80d81d49-127b-4bc7-aefc-1ba1678394c9 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Ensure instance console log exists: /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG nova.network.neutron [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] Releasing lock "refresh_cache-039fb13b-89bc-493c-af37-9f261ab5c077" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquired lock "refresh_cache-039fb13b-89bc-493c-af37-9f261ab5c077" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG nova.network.neutron [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Successfully created port: fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:10:12 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Updating instance_info_cache with network_info: [{"id": "05e7023b-90b4-42fb-a20d-554820d2afea", "address": "fa:16:3e:f6:97:13", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e7023b-90", "ovs_interfaceid": "05e7023b-90b4-42fb-a20d-554820d2afea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Releasing lock "refresh_cache-039fb13b-89bc-493c-af37-9f261ab5c077" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Instance network_info: |[{"id": "05e7023b-90b4-42fb-a20d-554820d2afea", "address": "fa:16:3e:f6:97:13", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e7023b-90", "ovs_interfaceid": "05e7023b-90b4-42fb-a20d-554820d2afea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Successfully updated port: fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "refresh_cache-80d81d49-127b-4bc7-aefc-1ba1678394c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquired lock "refresh_cache-80d81d49-127b-4bc7-aefc-1ba1678394c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Received event network-changed-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Refreshing instance network info cache due to event network-changed-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] Acquiring lock "refresh_cache-80d81d49-127b-4bc7-aefc-1ba1678394c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Updating instance_info_cache with network_info: [{"id": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "address": "fa:16:3e:9b:30:e6", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5e73f7-90", "ovs_interfaceid": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Releasing lock "refresh_cache-80d81d49-127b-4bc7-aefc-1ba1678394c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Instance network_info: |[{"id": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "address": "fa:16:3e:9b:30:e6", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5e73f7-90", "ovs_interfaceid": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] Acquired lock "refresh_cache-80d81d49-127b-4bc7-aefc-1ba1678394c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG nova.network.neutron [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Refreshing network info cache for port fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:10:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Start _get_guest_xml network_info=[{"id": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "address": "fa:16:3e:9b:30:e6", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5e73f7-90", "ovs_interfaceid": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:10:13 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:10:13 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1327390659',display_name='tempest-VolumesSnapshotTestJSON-instance-1327390659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1327390659',id=19,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='154fad18f802436d95b15503e470d942',ramdisk_id='',reservation_id='r-tdd9gwaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-76917881',owner_user_name='tempest-VolumesSnapshotTestJSON-76917881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:10:11Z,user_data=None,user_id='e3995d8045154666b0ae890dd3de5ef3',uuid=80d81d49-127b-4bc7-aefc-1ba1678394c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "address": "fa:16:3e:9b:30:e6", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5e73f7-90", "ovs_interfaceid": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Converting VIF {"id": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "address": "fa:16:3e:9b:30:e6", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5e73f7-90", "ovs_interfaceid": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:30:e6,bridge_name='br-int',has_traffic_filtering=True,id=fa5e73f7-905e-4a69-bd98-a9b5dcbd6785,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5e73f7-90') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.objects.instance [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'pci_devices' on Instance uuid 80d81d49-127b-4bc7-aefc-1ba1678394c9 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:10:14 user nova-compute[71516]:   <uuid>80d81d49-127b-4bc7-aefc-1ba1678394c9</uuid>
Apr 11 23:10:14 user nova-compute[71516]:   <name>instance-00000013</name>
Apr 11 23:10:14 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:10:14 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:10:14 user nova-compute[71516]:   <metadata>
Apr 11 23:10:14 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:10:14 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:10:14 user nova-compute[71516]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1327390659</nova:name>
Apr 11 23:10:14 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:10:13</nova:creationTime>
Apr 11 23:10:14 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:10:14 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:10:14 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:10:14 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:10:14 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:10:14 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:10:14 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:10:14 user nova-compute[71516]:       <nova:owner>
Apr 11 23:10:14 user nova-compute[71516]:         <nova:user uuid="e3995d8045154666b0ae890dd3de5ef3">tempest-VolumesSnapshotTestJSON-76917881-project-member</nova:user>
Apr 11 23:10:14 user nova-compute[71516]:         <nova:project uuid="154fad18f802436d95b15503e470d942">tempest-VolumesSnapshotTestJSON-76917881</nova:project>
Apr 11 23:10:14 user nova-compute[71516]:       </nova:owner>
Apr 11 23:10:14 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:10:14 user nova-compute[71516]:       <nova:ports>
Apr 11 23:10:14 user nova-compute[71516]:         <nova:port uuid="fa5e73f7-905e-4a69-bd98-a9b5dcbd6785">
Apr 11 23:10:14 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 23:10:14 user nova-compute[71516]:         </nova:port>
Apr 11 23:10:14 user nova-compute[71516]:       </nova:ports>
Apr 11 23:10:14 user nova-compute[71516]:     </nova:instance>
Apr 11 23:10:14 user nova-compute[71516]:   </metadata>
Apr 11 23:10:14 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:10:14 user nova-compute[71516]:     <system>
Apr 11 23:10:14 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:10:14 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:10:14 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:10:14 user nova-compute[71516]:       <entry name="serial">80d81d49-127b-4bc7-aefc-1ba1678394c9</entry>
Apr 11 23:10:14 user nova-compute[71516]:       <entry name="uuid">80d81d49-127b-4bc7-aefc-1ba1678394c9</entry>
Apr 11 23:10:14 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:10:14 user nova-compute[71516]:     </system>
Apr 11 23:10:14 user nova-compute[71516]:   </sysinfo>
Apr 11 23:10:14 user nova-compute[71516]:   <os>
Apr 11 23:10:14 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:10:14 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:10:14 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:10:14 user nova-compute[71516]:   </os>
Apr 11 23:10:14 user nova-compute[71516]:   <features>
Apr 11 23:10:14 user nova-compute[71516]:     <acpi/>
Apr 11 23:10:14 user nova-compute[71516]:     <apic/>
Apr 11 23:10:14 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:10:14 user nova-compute[71516]:   </features>
Apr 11 23:10:14 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:10:14 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:10:14 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:10:14 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:10:14 user nova-compute[71516]:   </clock>
Apr 11 23:10:14 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:10:14 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:10:14 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:10:14 user nova-compute[71516]:   </cpu>
Apr 11 23:10:14 user nova-compute[71516]:   <devices>
Apr 11 23:10:14 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:10:14 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:10:14 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk"/>
Apr 11 23:10:14 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:10:14 user nova-compute[71516]:     </disk>
Apr 11 23:10:14 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:10:14 user nova-compute[71516]:       <mac address="fa:16:3e:9b:30:e6"/>
Apr 11 23:10:14 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:10:14 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:10:14 user nova-compute[71516]:       <target dev="tapfa5e73f7-90"/>
Apr 11 23:10:14 user nova-compute[71516]:     </interface>
Apr 11 23:10:14 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:10:14 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/console.log" append="off"/>
Apr 11 23:10:14 user nova-compute[71516]:     </serial>
Apr 11 23:10:14 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:10:14 user nova-compute[71516]:     <video>
Apr 11 23:10:14 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:10:14 user nova-compute[71516]:     </video>
Apr 11 23:10:14 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:10:14 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:10:14 user nova-compute[71516]:     </rng>
Apr 11 23:10:14 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:10:14 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:10:14 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:10:14 user nova-compute[71516]:     </memballoon>
Apr 11 23:10:14 user nova-compute[71516]:   </devices>
Apr 11 23:10:14 user nova-compute[71516]: </domain>
Apr 11 23:10:14 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1327390659',display_name='tempest-VolumesSnapshotTestJSON-instance-1327390659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1327390659',id=19,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='154fad18f802436d95b15503e470d942',ramdisk_id='',reservation_id='r-tdd9gwaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-76917881',owner_user_name='tempest-VolumesSnapshotTestJSON-76917881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:10:11Z,user_data=None,user_id='e3995d8045154666b0ae890dd3de5ef3',uuid=80d81d49-127b-4bc7-aefc-1ba1678394c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "address": "fa:16:3e:9b:30:e6", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5e73f7-90", "ovs_interfaceid": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Converting VIF {"id": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "address": "fa:16:3e:9b:30:e6", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5e73f7-90", "ovs_interfaceid": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:30:e6,bridge_name='br-int',has_traffic_filtering=True,id=fa5e73f7-905e-4a69-bd98-a9b5dcbd6785,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5e73f7-90') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG os_vif [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:30:e6,bridge_name='br-int',has_traffic_filtering=True,id=fa5e73f7-905e-4a69-bd98-a9b5dcbd6785,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5e73f7-90') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa5e73f7-90, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa5e73f7-90, col_values=(('external_ids', {'iface-id': 'fa5e73f7-905e-4a69-bd98-a9b5dcbd6785', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:30:e6', 'vm-uuid': '80d81d49-127b-4bc7-aefc-1ba1678394c9'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:14 user nova-compute[71516]: INFO os_vif [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:30:e6,bridge_name='br-int',has_traffic_filtering=True,id=fa5e73f7-905e-4a69-bd98-a9b5dcbd6785,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5e73f7-90')
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] No VIF found with MAC fa:16:3e:9b:30:e6, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.network.neutron [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Updated VIF entry in instance network info cache for port fa5e73f7-905e-4a69-bd98-a9b5dcbd6785. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG nova.network.neutron [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Updating instance_info_cache with network_info: [{"id": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "address": "fa:16:3e:9b:30:e6", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5e73f7-90", "ovs_interfaceid": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] Releasing lock "refresh_cache-80d81d49-127b-4bc7-aefc-1ba1678394c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:10:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-1b0f4082-3d1b-462d-9602-7f9193cfe9cd req-b603a187-1d35-4b48-b8d2-a18b36878fa1 service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Received event network-vif-plugged-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1b0f4082-3d1b-462d-9602-7f9193cfe9cd req-b603a187-1d35-4b48-b8d2-a18b36878fa1 service nova] Acquiring lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1b0f4082-3d1b-462d-9602-7f9193cfe9cd req-b603a187-1d35-4b48-b8d2-a18b36878fa1 service nova] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1b0f4082-3d1b-462d-9602-7f9193cfe9cd req-b603a187-1d35-4b48-b8d2-a18b36878fa1 service nova] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-1b0f4082-3d1b-462d-9602-7f9193cfe9cd req-b603a187-1d35-4b48-b8d2-a18b36878fa1 service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] No waiting events found dispatching network-vif-plugged-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:15 user nova-compute[71516]: WARNING nova.compute.manager [req-1b0f4082-3d1b-462d-9602-7f9193cfe9cd req-b603a187-1d35-4b48-b8d2-a18b36878fa1 service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Received unexpected event network-vif-plugged-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 for instance with vm_state building and task_state spawning.
Apr 11 23:10:16 user nova-compute[71516]: DEBUG os_brick.utils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a2983b-688e-4f29-a081-e891d040d1a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebc536d-df47-4002-ba9e-2f2df8b95bf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1831afe-21f9-46c2-8eae-e0e26d573eb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c55d3f-6dc8-489d-8e15-23714c82a8a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:10:16 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:10:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[214ebb3a-57f5-4426-86e1-bc13066d40cb]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG os_brick.utils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:10:16 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Updating existing volume attachment record: 68a42ee9-f0d0-4e65-86ea-1f043b6fbc0d {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254617.7741578, 80d81d49-127b-4bc7-aefc-1ba1678394c9 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:10:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] VM Resumed (Lifecycle Event)
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:10:17 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Instance spawned successfully.
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254617.7770605, 80d81d49-127b-4bc7-aefc-1ba1678394c9 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:10:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] VM Started (Lifecycle Event)
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:10:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:10:17 user nova-compute[71516]: INFO nova.compute.manager [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Took 6.46 seconds to spawn the instance on the hypervisor.
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-03b11e2b-3d94-45be-94ce-f3dc6a24860d req-621823cd-b971-4013-aac4-f724a1f53211 service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Received event network-vif-plugged-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-03b11e2b-3d94-45be-94ce-f3dc6a24860d req-621823cd-b971-4013-aac4-f724a1f53211 service nova] Acquiring lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-03b11e2b-3d94-45be-94ce-f3dc6a24860d req-621823cd-b971-4013-aac4-f724a1f53211 service nova] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-03b11e2b-3d94-45be-94ce-f3dc6a24860d req-621823cd-b971-4013-aac4-f724a1f53211 service nova] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-03b11e2b-3d94-45be-94ce-f3dc6a24860d req-621823cd-b971-4013-aac4-f724a1f53211 service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] No waiting events found dispatching network-vif-plugged-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:17 user nova-compute[71516]: WARNING nova.compute.manager [req-03b11e2b-3d94-45be-94ce-f3dc6a24860d req-621823cd-b971-4013-aac4-f724a1f53211 service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Received unexpected event network-vif-plugged-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 for instance with vm_state building and task_state spawning.
Apr 11 23:10:17 user nova-compute[71516]: INFO nova.compute.manager [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Took 7.24 seconds to build instance.
Apr 11 23:10:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.341s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:10:20 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Creating image(s)
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Ensure instance console log exists: /opt/stack/data/nova/instances/039fb13b-89bc-493c-af37-9f261ab5c077/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Start _get_guest_xml network_info=[{"id": "05e7023b-90b4-42fb-a20d-554820d2afea", "address": "fa:16:3e:f6:97:13", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e7023b-90", "ovs_interfaceid": "05e7023b-90b4-42fb-a20d-554820d2afea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T23:10:07Z,direct_url=<?>,disk_format='qcow2',id=17af8c22-c9d1-475f-8a37-adcc7b531013,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1675638732',owner='f6700d66136e4f9590658e3103cceac8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T23:10:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFBJCwGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '039fb13b-89bc-493c-af37-9f261ab5c077', 'attached_at': '', 'detached_at': '', 'volume_id': '7eebf3f1-d0d0-4dc8-800a-28f15cd10734', 'serial': '7eebf3f1-d0d0-4dc8-800a-28f15cd10734'}, 'disk_bus': 'virtio', 'attachment_id': '68a42ee9-f0d0-4e65-86ea-1f043b6fbc0d', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:10:20 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:10:20 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T23:10:07Z,direct_url=<?>,disk_format='qcow2',id=17af8c22-c9d1-475f-8a37-adcc7b531013,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1675638732',owner='f6700d66136e4f9590658e3103cceac8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T23:10:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFBJCwGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:10:20 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:10:20 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:10:20 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abc0b7e-a1cb-435c-9900-41b492b5c6d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:10:20 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c40392-06b3-4c61-98aa-3bfb61381d01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734] added
Apr 11 23:10:20 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.105s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccf2de9-08df-461b-bfe0-c8e9d734bcb8]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f5c915-b725-41cc-bc6a-a78feaa7548f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFBJCwGz {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFBJCwGz" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc1c06d-7811-4b5b-98bb-c027a6da7cc7]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fFBJCwGz'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f95a570-afb5-4100-b286-6d0089163fc0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[66afded7-ed0f-41df-bff3-1a77edd56318]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:20 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:20 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:20 user nova-compute[71516]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 (non-flash)
Apr 11 23:10:20 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:20 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:20 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:20 user nova-compute[71516]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 (non-flash)
Apr 11 23:10:20 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4c3dc2-a493-47ed-bca7-1f074a2e9a8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734, portal: 172.16.0.220,3260]
Apr 11 23:10:20 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734, portal: 172.16.0.220,3260] successful.
Apr 11 23:10:20 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d487156-f4c1-4702-b377-be0f9dda8ff4]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f812ac-16fa-4ef5-9ab8-30c1863f8c4d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:21 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:21 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:21 user nova-compute[71516]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 (non-flash)
Apr 11 23:10:21 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:10:21 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:21 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:21 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:21 user nova-compute[71516]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 (non-flash)
Apr 11 23:10:21 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:10:21 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.105s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9a00fb-7fab-42c9-9be4-63496ab18577]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFBJCwGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 23:10:21 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] There are 0 instances to clean {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.527s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== connect_volume: return (1529ms) {'type': 'block', 'scsi_wwn': '26430663564616538', 'path': '/dev/sdf'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430663564616538', 'path': '/dev/sdf'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-520243177',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-520243177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-520243177',id=18,image_ref='17af8c22-c9d1-475f-8a37-adcc7b531013',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-icch06pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-365588456',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:10:10Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=039fb13b-89bc-493c-af37-9f261ab5c077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05e7023b-90b4-42fb-a20d-554820d2afea", "address": "fa:16:3e:f6:97:13", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e7023b-90", "ovs_interfaceid": "05e7023b-90b4-42fb-a20d-554820d2afea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "05e7023b-90b4-42fb-a20d-554820d2afea", "address": "fa:16:3e:f6:97:13", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e7023b-90", "ovs_interfaceid": "05e7023b-90b4-42fb-a20d-554820d2afea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:97:13,bridge_name='br-int',has_traffic_filtering=True,id=05e7023b-90b4-42fb-a20d-554820d2afea,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e7023b-90') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG nova.objects.instance [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lazy-loading 'pci_devices' on Instance uuid 039fb13b-89bc-493c-af37-9f261ab5c077 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:10:22 user nova-compute[71516]:   <uuid>039fb13b-89bc-493c-af37-9f261ab5c077</uuid>
Apr 11 23:10:22 user nova-compute[71516]:   <name>instance-00000012</name>
Apr 11 23:10:22 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:10:22 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:10:22 user nova-compute[71516]:   <metadata>
Apr 11 23:10:22 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:10:22 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:10:22 user nova-compute[71516]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-520243177</nova:name>
Apr 11 23:10:22 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:10:20</nova:creationTime>
Apr 11 23:10:22 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:10:22 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:10:22 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:10:22 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:10:22 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:10:22 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:10:22 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:10:22 user nova-compute[71516]:       <nova:owner>
Apr 11 23:10:22 user nova-compute[71516]:         <nova:user uuid="589c07cd12e849cfa38423959e76c695">tempest-TestVolumeBootPattern-365588456-project-member</nova:user>
Apr 11 23:10:22 user nova-compute[71516]:         <nova:project uuid="f6700d66136e4f9590658e3103cceac8">tempest-TestVolumeBootPattern-365588456</nova:project>
Apr 11 23:10:22 user nova-compute[71516]:       </nova:owner>
Apr 11 23:10:22 user nova-compute[71516]:       <nova:root type="image" uuid="17af8c22-c9d1-475f-8a37-adcc7b531013"/>
Apr 11 23:10:22 user nova-compute[71516]:       <nova:ports>
Apr 11 23:10:22 user nova-compute[71516]:         <nova:port uuid="05e7023b-90b4-42fb-a20d-554820d2afea">
Apr 11 23:10:22 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 23:10:22 user nova-compute[71516]:         </nova:port>
Apr 11 23:10:22 user nova-compute[71516]:       </nova:ports>
Apr 11 23:10:22 user nova-compute[71516]:     </nova:instance>
Apr 11 23:10:22 user nova-compute[71516]:   </metadata>
Apr 11 23:10:22 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:10:22 user nova-compute[71516]:     <system>
Apr 11 23:10:22 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:10:22 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:10:22 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:10:22 user nova-compute[71516]:       <entry name="serial">039fb13b-89bc-493c-af37-9f261ab5c077</entry>
Apr 11 23:10:22 user nova-compute[71516]:       <entry name="uuid">039fb13b-89bc-493c-af37-9f261ab5c077</entry>
Apr 11 23:10:22 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:10:22 user nova-compute[71516]:     </system>
Apr 11 23:10:22 user nova-compute[71516]:   </sysinfo>
Apr 11 23:10:22 user nova-compute[71516]:   <os>
Apr 11 23:10:22 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:10:22 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:10:22 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:10:22 user nova-compute[71516]:   </os>
Apr 11 23:10:22 user nova-compute[71516]:   <features>
Apr 11 23:10:22 user nova-compute[71516]:     <acpi/>
Apr 11 23:10:22 user nova-compute[71516]:     <apic/>
Apr 11 23:10:22 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:10:22 user nova-compute[71516]:   </features>
Apr 11 23:10:22 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:10:22 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:10:22 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:10:22 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:10:22 user nova-compute[71516]:   </clock>
Apr 11 23:10:22 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:10:22 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:10:22 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:10:22 user nova-compute[71516]:   </cpu>
Apr 11 23:10:22 user nova-compute[71516]:   <devices>
Apr 11 23:10:22 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:10:22 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:10:22 user nova-compute[71516]:       <source dev="/dev/sdf"/>
Apr 11 23:10:22 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:10:22 user nova-compute[71516]:       <serial>7eebf3f1-d0d0-4dc8-800a-28f15cd10734</serial>
Apr 11 23:10:22 user nova-compute[71516]:     </disk>
Apr 11 23:10:22 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:10:22 user nova-compute[71516]:       <mac address="fa:16:3e:f6:97:13"/>
Apr 11 23:10:22 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:10:22 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:10:22 user nova-compute[71516]:       <target dev="tap05e7023b-90"/>
Apr 11 23:10:22 user nova-compute[71516]:     </interface>
Apr 11 23:10:22 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:10:22 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/039fb13b-89bc-493c-af37-9f261ab5c077/console.log" append="off"/>
Apr 11 23:10:22 user nova-compute[71516]:     </serial>
Apr 11 23:10:22 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:10:22 user nova-compute[71516]:     <video>
Apr 11 23:10:22 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:10:22 user nova-compute[71516]:     </video>
Apr 11 23:10:22 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:10:22 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:10:22 user nova-compute[71516]:     </rng>
Apr 11 23:10:22 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:10:22 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:10:22 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:10:22 user nova-compute[71516]:     </memballoon>
Apr 11 23:10:22 user nova-compute[71516]:   </devices>
Apr 11 23:10:22 user nova-compute[71516]: </domain>
Apr 11 23:10:22 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-520243177',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-520243177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-520243177',id=18,image_ref='17af8c22-c9d1-475f-8a37-adcc7b531013',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-icch06pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-365588456',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:10:10Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=039fb13b-89bc-493c-af37-9f261ab5c077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05e7023b-90b4-42fb-a20d-554820d2afea", "address": "fa:16:3e:f6:97:13", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e7023b-90", "ovs_interfaceid": "05e7023b-90b4-42fb-a20d-554820d2afea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "05e7023b-90b4-42fb-a20d-554820d2afea", "address": "fa:16:3e:f6:97:13", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e7023b-90", "ovs_interfaceid": "05e7023b-90b4-42fb-a20d-554820d2afea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:97:13,bridge_name='br-int',has_traffic_filtering=True,id=05e7023b-90b4-42fb-a20d-554820d2afea,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e7023b-90') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG os_vif [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:97:13,bridge_name='br-int',has_traffic_filtering=True,id=05e7023b-90b4-42fb-a20d-554820d2afea,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e7023b-90') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05e7023b-90, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap05e7023b-90, col_values=(('external_ids', {'iface-id': '05e7023b-90b4-42fb-a20d-554820d2afea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:97:13', 'vm-uuid': '039fb13b-89bc-493c-af37-9f261ab5c077'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:22 user nova-compute[71516]: INFO os_vif [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:97:13,bridge_name='br-int',has_traffic_filtering=True,id=05e7023b-90b4-42fb-a20d-554820d2afea,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e7023b-90')
Apr 11 23:10:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:10:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] No VIF found with MAC fa:16:3e:f6:97:13, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:10:23 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:23 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances with incomplete migration  {{(pid=71516) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 23:10:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-067ea732-3361-466f-bcf5-11df9b86d8d0 req-ce2903de-bee0-40bd-96fd-db8c484c8a3f service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Received event network-vif-plugged-05e7023b-90b4-42fb-a20d-554820d2afea {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-067ea732-3361-466f-bcf5-11df9b86d8d0 req-ce2903de-bee0-40bd-96fd-db8c484c8a3f service nova] Acquiring lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-067ea732-3361-466f-bcf5-11df9b86d8d0 req-ce2903de-bee0-40bd-96fd-db8c484c8a3f service nova] Lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-067ea732-3361-466f-bcf5-11df9b86d8d0 req-ce2903de-bee0-40bd-96fd-db8c484c8a3f service nova] Lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-067ea732-3361-466f-bcf5-11df9b86d8d0 req-ce2903de-bee0-40bd-96fd-db8c484c8a3f service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] No waiting events found dispatching network-vif-plugged-05e7023b-90b4-42fb-a20d-554820d2afea {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:24 user nova-compute[71516]: WARNING nova.compute.manager [req-067ea732-3361-466f-bcf5-11df9b86d8d0 req-ce2903de-bee0-40bd-96fd-db8c484c8a3f service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Received unexpected event network-vif-plugged-05e7023b-90b4-42fb-a20d-554820d2afea for instance with vm_state building and task_state spawning.
Apr 11 23:10:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:25 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254625.9434166, 039fb13b-89bc-493c-af37-9f261ab5c077 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:10:25 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] VM Resumed (Lifecycle Event)
Apr 11 23:10:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:10:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:10:25 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Instance spawned successfully.
Apr 11 23:10:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:10:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:10:26 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:10:26 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254625.945872, 039fb13b-89bc-493c-af37-9f261ab5c077 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:10:26 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] VM Started (Lifecycle Event)
Apr 11 23:10:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:10:26 user nova-compute[71516]: INFO nova.compute.manager [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Took 5.47 seconds to spawn the instance on the hypervisor.
Apr 11 23:10:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:26 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:10:26 user nova-compute[71516]: INFO nova.compute.manager [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Took 16.63 seconds to build instance.
Apr 11 23:10:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-8ceb5852-9fbf-41ee-9995-67e5a9cbd98f req-ee4ea262-8f68-4a1e-b358-ce295ee6a2cc service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Received event network-vif-plugged-05e7023b-90b4-42fb-a20d-554820d2afea {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8ceb5852-9fbf-41ee-9995-67e5a9cbd98f req-ee4ea262-8f68-4a1e-b358-ce295ee6a2cc service nova] Acquiring lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8ceb5852-9fbf-41ee-9995-67e5a9cbd98f req-ee4ea262-8f68-4a1e-b358-ce295ee6a2cc service nova] Lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8ceb5852-9fbf-41ee-9995-67e5a9cbd98f req-ee4ea262-8f68-4a1e-b358-ce295ee6a2cc service nova] Lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-8ceb5852-9fbf-41ee-9995-67e5a9cbd98f req-ee4ea262-8f68-4a1e-b358-ce295ee6a2cc service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] No waiting events found dispatching network-vif-plugged-05e7023b-90b4-42fb-a20d-554820d2afea {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:26 user nova-compute[71516]: WARNING nova.compute.manager [req-8ceb5852-9fbf-41ee-9995-67e5a9cbd98f req-ee4ea262-8f68-4a1e-b358-ce295ee6a2cc service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Received unexpected event network-vif-plugged-05e7023b-90b4-42fb-a20d-554820d2afea for instance with vm_state active and task_state None.
Apr 11 23:10:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "039fb13b-89bc-493c-af37-9f261ab5c077" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.726s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Updating instance_info_cache with network_info: [{"id": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "address": "fa:16:3e:28:ea:b9", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32a4080-99", "ovs_interfaceid": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:10:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:10:27 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:10:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "8322b884-2831-48af-a67e-26c31c17f49f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:30 user nova-compute[71516]: INFO nova.compute.manager [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Detaching volume 12247dde-59fb-47e6-b624-bc8b349687a0
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: INFO nova.virt.block_device [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Attempting to driver detach volume 12247dde-59fb-47e6-b624-bc8b349687a0 from mountpoint /dev/vdc
Apr 11 23:10:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Attempting to detach device vdc from instance 8322b884-2831-48af-a67e-26c31c17f49f from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:10:30 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:10:30 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:10:30 user nova-compute[71516]:   <target dev="vdc" bus="virtio"/>
Apr 11 23:10:30 user nova-compute[71516]:   <serial>12247dde-59fb-47e6-b624-bc8b349687a0</serial>
Apr 11 23:10:30 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 23:10:30 user nova-compute[71516]: </disk>
Apr 11 23:10:30 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:10:30 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Successfully detached device vdc from instance 8322b884-2831-48af-a67e-26c31c17f49f from the persistent domain config.
Apr 11 23:10:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8322b884-2831-48af-a67e-26c31c17f49f from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:10:30 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:10:30 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:10:30 user nova-compute[71516]:   <target dev="vdc" bus="virtio"/>
Apr 11 23:10:30 user nova-compute[71516]:   <serial>12247dde-59fb-47e6-b624-bc8b349687a0</serial>
Apr 11 23:10:30 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 23:10:30 user nova-compute[71516]: </disk>
Apr 11 23:10:30 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681254630.7160635, 8322b884-2831-48af-a67e-26c31c17f49f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:10:30 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Successfully detached device vdc from instance 8322b884-2831-48af-a67e-26c31c17f49f from the live domain config.
Apr 11 23:10:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WIgkFsfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:10:30 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcde62c-e5cc-4a68-8453-35ac916f625e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:10:30 user nova-compute[71516]: No targets found.
Apr 11 23:10:30 user nova-compute[71516]: iSNS:
Apr 11 23:10:30 user nova-compute[71516]: No targets found.
Apr 11 23:10:30 user nova-compute[71516]: STATIC:
Apr 11 23:10:30 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0
Apr 11 23:10:30 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:10:30 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:10:30 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d
Apr 11 23:10:30 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:10:30 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:10:30 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734
Apr 11 23:10:30 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:10:30 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:10:30 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5
Apr 11 23:10:30 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:10:30 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:10:30 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4
Apr 11 23:10:30 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:10:30 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:10:30 user nova-compute[71516]: FIRMWARE:
Apr 11 23:10:30 user nova-compute[71516]: No targets found.
Apr 11 23:10:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:10:30 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:10:30 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfae8119-efde-46d4-85e7-ace7d0c70242]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[29605660-88a9-4fc8-97be-534ffd24ca37]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:30 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:30 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:30 user nova-compute[71516]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 (non-flash)
Apr 11 23:10:30 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:10:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:30 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:30 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:30 user nova-compute[71516]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 (non-flash)
Apr 11 23:10:30 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:10:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c79c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0'): ({'sde'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Removing single pathed devices sde {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e51cbd-fcda-481a-b253-dfdcc014cd4d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b209d15-7ff2-423b-b88a-4a3d34f68659]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Flushing IO for device /dev/sde {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c716fc7-16ff-4a94-8b81-d0ca7439e05a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[818fd27b-b7f6-4160-a4db-43710a308252]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba34e09-9427-4679-a147-6ed49a9d6342]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f56af93-5f37-4c7c-a202-e5434556cf04]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0, portal: 172.16.0.220,3260]
Apr 11 23:10:31 user nova-compute[71516]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0, portal: 172.16.0.220,3260] successful.
Apr 11 23:10:31 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12247dde-59fb-47e6-b624-bc8b349687a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf4cc9d-0733-4d39-a8b1-0159a06953fd]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] <== disconnect_volume: return (355ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:10:31 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:10:31 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:10:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=7651MB free_disk=26.29998779296875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG nova.objects.instance [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'flavor' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:31 user nova-compute[71516]: INFO nova.compute.manager [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Unrescuing
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquired lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:10:31 user nova-compute[71516]: DEBUG nova.network.neutron [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "8322b884-2831-48af-a67e-26c31c17f49f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.882s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 4f95b120-0c70-45a5-969f-c1728c72d420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 8322b884-2831-48af-a67e-26c31c17f49f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f2a79a44-800e-4142-b778-aae06a5c779d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e4d31874-4273-48bc-8811-89832d18b893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance a95ec17c-3200-4f51-be89-116ee3306968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 039fb13b-89bc-493c-af37-9f261ab5c077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing inventories for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating ProviderTree inventory for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating inventory in ProviderTree for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing aggregate associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, aggregates: None {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing trait associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updating instance_info_cache with network_info: [{"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Releasing lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.objects.instance [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'flavor' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.manager [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-changed-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.manager [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Refreshing instance network info cache due to event network-changed-7a130357-a93e-4aad-8404-d4b5b8dd7022. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] Acquiring lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] Acquired lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.network.neutron [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Refreshing network info cache for port 7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.822s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.manager [req-b252ecc7-d8bf-49ab-b339-e373174ec177 req-259bca65-3a63-4926-a4d7-b759f9dd0bc2 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-unplugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b252ecc7-d8bf-49ab-b339-e373174ec177 req-259bca65-3a63-4926-a4d7-b759f9dd0bc2 service nova] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b252ecc7-d8bf-49ab-b339-e373174ec177 req-259bca65-3a63-4926-a4d7-b759f9dd0bc2 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b252ecc7-d8bf-49ab-b339-e373174ec177 req-259bca65-3a63-4926-a4d7-b759f9dd0bc2 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:32 user nova-compute[71516]: DEBUG nova.compute.manager [req-b252ecc7-d8bf-49ab-b339-e373174ec177 req-259bca65-3a63-4926-a4d7-b759f9dd0bc2 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] No waiting events found dispatching network-vif-unplugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:32 user nova-compute[71516]: WARNING nova.compute.manager [req-b252ecc7-d8bf-49ab-b339-e373174ec177 req-259bca65-3a63-4926-a4d7-b759f9dd0bc2 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received unexpected event network-vif-unplugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:10:33 user nova-compute[71516]: DEBUG nova.network.neutron [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updated VIF entry in instance network info cache for port 7a130357-a93e-4aad-8404-d4b5b8dd7022. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:10:33 user nova-compute[71516]: DEBUG nova.network.neutron [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updating instance_info_cache with network_info: [{"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] Releasing lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:10:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Instance destroyed successfully.
Apr 11 23:10:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:10:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:34 user nova-compute[71516]: DEBUG nova.compute.manager [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-changed-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:34 user nova-compute[71516]: DEBUG nova.compute.manager [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Refreshing instance network info cache due to event network-changed-7a130357-a93e-4aad-8404-d4b5b8dd7022. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:10:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] Acquiring lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:10:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] Acquired lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:10:34 user nova-compute[71516]: DEBUG nova.network.neutron [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Refreshing network info cache for port 7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] No waiting events found dispatching network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:35 user nova-compute[71516]: WARNING nova.compute.manager [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received unexpected event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:10:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] No waiting events found dispatching network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:35 user nova-compute[71516]: WARNING nova.compute.manager [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received unexpected event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:10:35 user nova-compute[71516]: DEBUG nova.network.neutron [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updated VIF entry in instance network info cache for port 7a130357-a93e-4aad-8404-d4b5b8dd7022. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG nova.network.neutron [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updating instance_info_cache with network_info: [{"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] Releasing lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for 4f95b120-0c70-45a5-969f-c1728c72d420 due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:10:36 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254636.8226523, 4f95b120-0c70-45a5-969f-c1728c72d420 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:10:36 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] VM Resumed (Lifecycle Event)
Apr 11 23:10:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:10:36 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 23:10:36 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254636.8266242, 4f95b120-0c70-45a5-969f-c1728c72d420 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:10:36 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] VM Started (Lifecycle Event)
Apr 11 23:10:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:10:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-15491837-08d8-460e-8bf8-c412eadb68fe req-1d55892b-3ff1-4452-910b-76eb21f0513c service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-15491837-08d8-460e-8bf8-c412eadb68fe req-1d55892b-3ff1-4452-910b-76eb21f0513c service nova] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-15491837-08d8-460e-8bf8-c412eadb68fe req-1d55892b-3ff1-4452-910b-76eb21f0513c service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-15491837-08d8-460e-8bf8-c412eadb68fe req-1d55892b-3ff1-4452-910b-76eb21f0513c service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-15491837-08d8-460e-8bf8-c412eadb68fe req-1d55892b-3ff1-4452-910b-76eb21f0513c service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] No waiting events found dispatching network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:37 user nova-compute[71516]: WARNING nova.compute.manager [req-15491837-08d8-460e-8bf8-c412eadb68fe req-1d55892b-3ff1-4452-910b-76eb21f0513c service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received unexpected event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance with vm_state active and task_state None.
Apr 11 23:10:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Received event network-changed-970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Refreshing instance network info cache due to event network-changed-970d841b-bbfc-409e-8ec5-ddbea8be8c5d. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:10:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] Acquiring lock "refresh_cache-f2a79a44-800e-4142-b778-aae06a5c779d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:10:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] Acquired lock "refresh_cache-f2a79a44-800e-4142-b778-aae06a5c779d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:10:39 user nova-compute[71516]: DEBUG nova.network.neutron [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Refreshing network info cache for port 970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f2a79a44-800e-4142-b778-aae06a5c779d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2a79a44-800e-4142-b778-aae06a5c779d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG nova.objects.instance [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'flavor' on Instance uuid f2a79a44-800e-4142-b778-aae06a5c779d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG nova.network.neutron [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Updated VIF entry in instance network info cache for port 970d841b-bbfc-409e-8ec5-ddbea8be8c5d. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG nova.network.neutron [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Updating instance_info_cache with network_info: [{"id": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "address": "fa:16:3e:16:12:b6", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970d841b-bb", "ovs_interfaceid": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] Releasing lock "refresh_cache-f2a79a44-800e-4142-b778-aae06a5c779d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2a79a44-800e-4142-b778-aae06a5c779d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f2a79a44-800e-4142-b778-aae06a5c779d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2a79a44-800e-4142-b778-aae06a5c779d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:40 user nova-compute[71516]: INFO nova.compute.manager [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Attaching volume 0495c378-b313-45ae-9438-2c19c513e9ee to /dev/vdb
Apr 11 23:10:40 user nova-compute[71516]: DEBUG os_brick.utils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbd3d89-3ae0-4a59-ade2-bb5202fbfb03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba58d03-07b8-4183-97ad-d1feb568a11f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c47099-93f4-4df0-bea6-71b8d02048d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae10d4aa-2336-4441-b25c-6d867d2df2a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:10:40 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:10:40 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[235b36fe-ad77-4de8-bc9c-13c25ec22aef]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG os_brick.utils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:10:40 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Updating existing volume attachment record: 8005305e-3087-490c-9ac1-059348bcf730 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-changed-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Refreshing instance network info cache due to event network-changed-ac90e400-803b-41b5-b183-f93bfbf297b6. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] Acquiring lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] Acquired lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG nova.network.neutron [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Refreshing network info cache for port ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:41 user nova-compute[71516]: INFO nova.compute.manager [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Terminating instance
Apr 11 23:10:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG nova.network.neutron [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Updated VIF entry in instance network info cache for port ac90e400-803b-41b5-b183-f93bfbf297b6. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG nova.network.neutron [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Updating instance_info_cache with network_info: [{"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] Releasing lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-f7548f54-226b-41c7-8e76-88c5adab5e2e req-320737ad-a3a8-4570-8aae-4459da8c07e1 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Received event network-vif-unplugged-ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f7548f54-226b-41c7-8e76-88c5adab5e2e req-320737ad-a3a8-4570-8aae-4459da8c07e1 service nova] Acquiring lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f7548f54-226b-41c7-8e76-88c5adab5e2e req-320737ad-a3a8-4570-8aae-4459da8c07e1 service nova] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f7548f54-226b-41c7-8e76-88c5adab5e2e req-320737ad-a3a8-4570-8aae-4459da8c07e1 service nova] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-f7548f54-226b-41c7-8e76-88c5adab5e2e req-320737ad-a3a8-4570-8aae-4459da8c07e1 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] No waiting events found dispatching network-vif-unplugged-ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-f7548f54-226b-41c7-8e76-88c5adab5e2e req-320737ad-a3a8-4570-8aae-4459da8c07e1 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Received event network-vif-unplugged-ac411bad-0310-4c20-946a-b95b7b3e3e16 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Instance destroyed successfully.
Apr 11 23:10:42 user nova-compute[71516]: DEBUG nova.objects.instance [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lazy-loading 'resources' on Instance uuid fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-733558945',display_name='tempest-VolumesAdminNegativeTest-server-733558945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-733558945',id=5,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8ODpXY5bZgmxO5t5Y4E36zk4OtZoXs0KgN3E2IDtgASaVQEDy8SuRh1bds0DVt6hO2bRftrq5qk08LxQJMvdhB80a5j4F6edXn56zcx8okMNhfO4isidv+PZkrEFpPhw==',key_name='tempest-keypair-1401661035',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c24d77b00c084f6f857147717350b6e0',ramdisk_id='',reservation_id='r-bpmmsnup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-497834960',owner_user_name='tempest-VolumesAdminNegativeTest-497834960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:05:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='340848f1de07428e85af2cf660943c3e',uuid=fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "address": "fa:16:3e:e1:c0:a4", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac411bad-03", "ovs_interfaceid": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Converting VIF {"id": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "address": "fa:16:3e:e1:c0:a4", "network": {"id": "0678e3e7-49ce-4482-b828-84fd3ed1cf15", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1635843495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d77b00c084f6f857147717350b6e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac411bad-03", "ovs_interfaceid": "ac411bad-0310-4c20-946a-b95b7b3e3e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:c0:a4,bridge_name='br-int',has_traffic_filtering=True,id=ac411bad-0310-4c20-946a-b95b7b3e3e16,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac411bad-03') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG os_vif [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:c0:a4,bridge_name='br-int',has_traffic_filtering=True,id=ac411bad-0310-4c20-946a-b95b7b3e3e16,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac411bad-03') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac411bad-03, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:42 user nova-compute[71516]: INFO os_vif [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:c0:a4,bridge_name='br-int',has_traffic_filtering=True,id=ac411bad-0310-4c20-946a-b95b7b3e3e16,network=Network(0678e3e7-49ce-4482-b828-84fd3ed1cf15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac411bad-03')
Apr 11 23:10:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Deleting instance files /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3_del
Apr 11 23:10:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Deletion of /opt/stack/data/nova/instances/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3_del complete
Apr 11 23:10:42 user nova-compute[71516]: INFO nova.compute.manager [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 11 23:10:42 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG nova.objects.instance [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'flavor' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:42 user nova-compute[71516]: INFO nova.compute.manager [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Attaching volume 75f7d204-26d3-4992-8036-0690d066ab68 to /dev/vdb
Apr 11 23:10:42 user nova-compute[71516]: DEBUG os_brick.utils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:10:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45400fc-4934-4259-930e-b865efb4cd8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe04b4f-58e3-485b-985f-13a330eda990]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1218287-89ff-4027-bdcb-f613b329ecbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42523c6-fa68-41a1-bc07-ff2683db6271]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:10:43 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c958fd-f9cc-4c3a-acd1-50e268ee5712]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG os_brick.utils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Updating existing volume attachment record: f64a2948-7d58-4bc1-9cc3-83d1eb2721a3 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG nova.compute.manager [req-c61bedfa-19d6-4272-aa08-8bf67d526037 req-d23e471e-7243-435d-a8b1-696b9301358a service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Received event network-vif-deleted-ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:43 user nova-compute[71516]: INFO nova.compute.manager [req-c61bedfa-19d6-4272-aa08-8bf67d526037 req-d23e471e-7243-435d-a8b1-696b9301358a service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Neutron deleted interface ac411bad-0310-4c20-946a-b95b7b3e3e16; detaching it from the instance and deleting it from the info cache
Apr 11 23:10:43 user nova-compute[71516]: DEBUG nova.network.neutron [req-c61bedfa-19d6-4272-aa08-8bf67d526037 req-d23e471e-7243-435d-a8b1-696b9301358a service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:43 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Took 0.86 seconds to deallocate network for instance.
Apr 11 23:10:43 user nova-compute[71516]: DEBUG nova.compute.manager [req-c61bedfa-19d6-4272-aa08-8bf67d526037 req-d23e471e-7243-435d-a8b1-696b9301358a service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Detach interface failed, port_id=ac411bad-0310-4c20-946a-b95b7b3e3e16, reason: Instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:43 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Deleted allocations for instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3
Apr 11 23:10:43 user nova-compute[71516]: DEBUG nova.compute.manager [req-e23d42dd-5a35-4719-a5cc-9bce1f8dc535 req-c6bb1f9f-6a7e-4db3-8de8-3a6722db0962 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Received event network-vif-plugged-ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e23d42dd-5a35-4719-a5cc-9bce1f8dc535 req-c6bb1f9f-6a7e-4db3-8de8-3a6722db0962 service nova] Acquiring lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e23d42dd-5a35-4719-a5cc-9bce1f8dc535 req-c6bb1f9f-6a7e-4db3-8de8-3a6722db0962 service nova] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e23d42dd-5a35-4719-a5cc-9bce1f8dc535 req-c6bb1f9f-6a7e-4db3-8de8-3a6722db0962 service nova] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:43 user nova-compute[71516]: DEBUG nova.compute.manager [req-e23d42dd-5a35-4719-a5cc-9bce1f8dc535 req-c6bb1f9f-6a7e-4db3-8de8-3a6722db0962 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] No waiting events found dispatching network-vif-plugged-ac411bad-0310-4c20-946a-b95b7b3e3e16 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:43 user nova-compute[71516]: WARNING nova.compute.manager [req-e23d42dd-5a35-4719-a5cc-9bce1f8dc535 req-c6bb1f9f-6a7e-4db3-8de8-3a6722db0962 service nova] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Received unexpected event network-vif-plugged-ac411bad-0310-4c20-946a-b95b7b3e3e16 for instance with vm_state deleted and task_state None.
Apr 11 23:10:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.480s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hmSYawFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:10:45 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:10:45 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:10:45 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a1eea9-6456-4219-af92-6a7746a80da0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:10:45 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a149a2c7-fc2c-48f1-b44c-b299c76a75e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee] added
Apr 11 23:10:45 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[26228f7d-1af4-4822-8b2b-5f3cab6774fd]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2672e8-f262-4aea-8e36-8d8dc1e0d03e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hmSYawFt {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hmSYawFt" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d0d1e6-f83c-4103-b9ba-013f138f4664]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hmSYawFt'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb8837d-fb2d-45e3-bf53-dd36936a5c10]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9539f870-bbb7-4696-b30f-019ae40911b7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:10:45 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:10:45 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6221083-0cd5-45c9-b394-966fc10394a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee, portal: 172.16.0.220,3260]
Apr 11 23:10:45 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee, portal: 172.16.0.220,3260] successful.
Apr 11 23:10:45 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb952ac2-359a-4f8a-a84d-ded165581409]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcba601-389c-444f-ac3b-edcd4affd218]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:10:45 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:10:45 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:10:45 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6524a54f-3c4c-492e-b301-34ee17102226]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:10:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hmSYawFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:10:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:10:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23664326136393262', 'path': '/dev/sde'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:10:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664326136393262', 'path': '/dev/sde'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:10:46 user nova-compute[71516]: DEBUG nova.objects.instance [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'flavor' on Instance uuid f2a79a44-800e-4142-b778-aae06a5c779d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:10:46 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:10:46 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:10:46 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:10:46 user nova-compute[71516]:   <serial>0495c378-b313-45ae-9438-2c19c513e9ee</serial>
Apr 11 23:10:46 user nova-compute[71516]: </disk>
Apr 11 23:10:46 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No VIF found with MAC fa:16:3e:16:12:b6, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2a79a44-800e-4142-b778-aae06a5c779d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.644s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etIkblUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:10:47 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:10:47 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:10:47 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[038efe29-5aa6-488d-9be0-ad50af5a3d34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:10:47 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c354c48a-a261-4511-b046-9018572b74f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68] added
Apr 11 23:10:47 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[14480947-0a17-461d-ac48-3579352f4e7a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fdbf80-aa7a-4554-874d-d0701db725a0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etIkblUW {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etIkblUW" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56651ea-cefb-4241-a401-8fc94ffdca7a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etIkblUW'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9599aa-2e2f-4bc5-aa81-46dd68d861fc]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec49e54-1cc9-497e-a9f1-75386efe0c9f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:10:47 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:10:47 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afb1dd8-0f45-4097-8916-e91b1e602281]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260]
Apr 11 23:10:47 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260] successful.
Apr 11 23:10:47 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ec0d92-0c94-45cf-8c7d-4c4bdcd79c81]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a139e038-d6f8-46a9-8eed-e3502842856d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:10:47 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:10:47 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] HCTL ('38', '-', '-', 0) found on session 22 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91e4480-95a3-4ded-8a1a-30e17e15cd50]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:10:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etIkblUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:10:48 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:10:48 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26666663137646533', 'path': '/dev/sdg'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:10:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666663137646533', 'path': '/dev/sdg'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:10:48 user nova-compute[71516]: DEBUG nova.objects.instance [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'flavor' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:10:48 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:10:48 user nova-compute[71516]:   <source dev="/dev/sdg"/>
Apr 11 23:10:48 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:10:48 user nova-compute[71516]:   <serial>75f7d204-26d3-4992-8036-0690d066ab68</serial>
Apr 11 23:10:48 user nova-compute[71516]: </disk>
Apr 11 23:10:48 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No VIF found with MAC fa:16:3e:f7:1e:78, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.457s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_power_states {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid f2a79a44-800e-4142-b778-aae06a5c779d {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid a95ec17c-3200-4f51-be89-116ee3306968 {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid 039fb13b-89bc-493c-af37-9f261ab5c077 {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid 80d81d49-127b-4bc7-aefc-1ba1678394c9 {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "4f95b120-0c70-45a5-969f-c1728c72d420" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "8322b884-2831-48af-a67e-26c31c17f49f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "f2a79a44-800e-4142-b778-aae06a5c779d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "f2a79a44-800e-4142-b778-aae06a5c779d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "e4d31874-4273-48bc-8811-89832d18b893" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "a95ec17c-3200-4f51-be89-116ee3306968" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "a95ec17c-3200-4f51-be89-116ee3306968" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "039fb13b-89bc-493c-af37-9f261ab5c077" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "039fb13b-89bc-493c-af37-9f261ab5c077" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "4f95b120-0c70-45a5-969f-c1728c72d420" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "f2a79a44-800e-4142-b778-aae06a5c779d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "8322b884-2831-48af-a67e-26c31c17f49f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "039fb13b-89bc-493c-af37-9f261ab5c077" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "e4d31874-4273-48bc-8811-89832d18b893" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "a95ec17c-3200-4f51-be89-116ee3306968" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-57158013-1e3f-4968-be79-2637ae51261f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-57158013-1e3f-4968-be79-2637ae51261f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-57158013-1e3f-4968-be79-2637ae51261f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-57158013-1e3f-4968-be79-2637ae51261f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71516) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG nova.objects.instance [None req-57158013-1e3f-4968-be79-2637ae51261f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'flavor' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-071998ba-a44b-4eb1-93d5-c55e71fd5487 req-f5df659a-aad7-42cc-b7d8-d0f006943bb4 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-unplugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-071998ba-a44b-4eb1-93d5-c55e71fd5487 req-f5df659a-aad7-42cc-b7d8-d0f006943bb4 service nova] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-071998ba-a44b-4eb1-93d5-c55e71fd5487 req-f5df659a-aad7-42cc-b7d8-d0f006943bb4 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-071998ba-a44b-4eb1-93d5-c55e71fd5487 req-f5df659a-aad7-42cc-b7d8-d0f006943bb4 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-071998ba-a44b-4eb1-93d5-c55e71fd5487 req-f5df659a-aad7-42cc-b7d8-d0f006943bb4 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] No waiting events found dispatching network-vif-unplugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:50 user nova-compute[71516]: WARNING nova.compute.manager [req-071998ba-a44b-4eb1-93d5-c55e71fd5487 req-f5df659a-aad7-42cc-b7d8-d0f006943bb4 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received unexpected event network-vif-unplugged-ac90e400-803b-41b5-b183-f93bfbf297b6 for instance with vm_state active and task_state powering-off.
Apr 11 23:10:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:50 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:10:50 user nova-compute[71516]: INFO nova.compute.claims [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Claim successful on node user
Apr 11 23:10:51 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG nova.network.neutron [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:10:51 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:10:51 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] Instance destroyed successfully.
Apr 11 23:10:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-57158013-1e3f-4968-be79-2637ae51261f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-57158013-1e3f-4968-be79-2637ae51261f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.868s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG nova.policy [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:10:51 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Creating image(s)
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "/opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "/opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk 1073741824" returned: 0 in 0.045s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.128s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Cannot resize image /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG nova.objects.instance [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'migration_context' on Instance uuid f2f6794f-cdcf-422e-8ae5-030fc2c3213b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Ensure instance console log exists: /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG nova.network.neutron [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Successfully created port: 9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG nova.network.neutron [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Successfully updated port: 9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "refresh_cache-f2f6794f-cdcf-422e-8ae5-030fc2c3213b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquired lock "refresh_cache-f2f6794f-cdcf-422e-8ae5-030fc2c3213b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG nova.network.neutron [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Received event network-changed-9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Refreshing instance network info cache due to event network-changed-9c2c207b-c711-42ef-9608-cbb701d5406f. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] Acquiring lock "refresh_cache-f2f6794f-cdcf-422e-8ae5-030fc2c3213b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:10:52 user nova-compute[71516]: DEBUG nova.network.neutron [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-370a5128-b792-4636-b46f-87a583467c0e req-14fcfb59-e70b-484f-b86f-a4e6c4c46c1c service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-370a5128-b792-4636-b46f-87a583467c0e req-14fcfb59-e70b-484f-b86f-a4e6c4c46c1c service nova] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-370a5128-b792-4636-b46f-87a583467c0e req-14fcfb59-e70b-484f-b86f-a4e6c4c46c1c service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-370a5128-b792-4636-b46f-87a583467c0e req-14fcfb59-e70b-484f-b86f-a4e6c4c46c1c service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-370a5128-b792-4636-b46f-87a583467c0e req-14fcfb59-e70b-484f-b86f-a4e6c4c46c1c service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] No waiting events found dispatching network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:53 user nova-compute[71516]: WARNING nova.compute.manager [req-370a5128-b792-4636-b46f-87a583467c0e req-14fcfb59-e70b-484f-b86f-a4e6c4c46c1c service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received unexpected event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 for instance with vm_state stopped and task_state None.
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Updating instance_info_cache with network_info: [{"id": "9c2c207b-c711-42ef-9608-cbb701d5406f", "address": "fa:16:3e:74:c4:27", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c207b-c7", "ovs_interfaceid": "9c2c207b-c711-42ef-9608-cbb701d5406f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Releasing lock "refresh_cache-f2f6794f-cdcf-422e-8ae5-030fc2c3213b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Instance network_info: |[{"id": "9c2c207b-c711-42ef-9608-cbb701d5406f", "address": "fa:16:3e:74:c4:27", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c207b-c7", "ovs_interfaceid": "9c2c207b-c711-42ef-9608-cbb701d5406f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] Acquired lock "refresh_cache-f2f6794f-cdcf-422e-8ae5-030fc2c3213b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Refreshing network info cache for port 9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Start _get_guest_xml network_info=[{"id": "9c2c207b-c711-42ef-9608-cbb701d5406f", "address": "fa:16:3e:74:c4:27", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c207b-c7", "ovs_interfaceid": "9c2c207b-c711-42ef-9608-cbb701d5406f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:10:53 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:10:53 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1566798189',display_name='tempest-AttachVolumeNegativeTest-server-1566798189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1566798189',id=20,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBMEewzXEFy6CSMxptTsXBa5J41k9pW5kYlrexIdLtOBRh01epIt7LV7EDJlwObFzREbUoeDYDcdXxxRAjnOopOEfu8u05/8uauEotW0z7ypKiOFDNzAI9D4I71bSqQGg==',key_name='tempest-keypair-871178907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f29d28c472c4f65b8437ce443d208c7',ramdisk_id='',reservation_id='r-703ls7p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2123485934',owner_user_name='tempest-AttachVolumeNegativeTest-2123485934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da1389f3e27f49f394598636d041a9c9',uuid=f2f6794f-cdcf-422e-8ae5-030fc2c3213b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c2c207b-c711-42ef-9608-cbb701d5406f", "address": "fa:16:3e:74:c4:27", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c207b-c7", "ovs_interfaceid": "9c2c207b-c711-42ef-9608-cbb701d5406f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converting VIF {"id": "9c2c207b-c711-42ef-9608-cbb701d5406f", "address": "fa:16:3e:74:c4:27", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c207b-c7", "ovs_interfaceid": "9c2c207b-c711-42ef-9608-cbb701d5406f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=9c2c207b-c711-42ef-9608-cbb701d5406f,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c207b-c7') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.objects.instance [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'pci_devices' on Instance uuid f2f6794f-cdcf-422e-8ae5-030fc2c3213b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:10:53 user nova-compute[71516]:   <uuid>f2f6794f-cdcf-422e-8ae5-030fc2c3213b</uuid>
Apr 11 23:10:53 user nova-compute[71516]:   <name>instance-00000014</name>
Apr 11 23:10:53 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:10:53 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:10:53 user nova-compute[71516]:   <metadata>
Apr 11 23:10:53 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:10:53 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:10:53 user nova-compute[71516]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1566798189</nova:name>
Apr 11 23:10:53 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:10:53</nova:creationTime>
Apr 11 23:10:53 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:10:53 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:10:53 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:10:53 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:10:53 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:10:53 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:10:53 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:10:53 user nova-compute[71516]:       <nova:owner>
Apr 11 23:10:53 user nova-compute[71516]:         <nova:user uuid="da1389f3e27f49f394598636d041a9c9">tempest-AttachVolumeNegativeTest-2123485934-project-member</nova:user>
Apr 11 23:10:53 user nova-compute[71516]:         <nova:project uuid="9f29d28c472c4f65b8437ce443d208c7">tempest-AttachVolumeNegativeTest-2123485934</nova:project>
Apr 11 23:10:53 user nova-compute[71516]:       </nova:owner>
Apr 11 23:10:53 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:10:53 user nova-compute[71516]:       <nova:ports>
Apr 11 23:10:53 user nova-compute[71516]:         <nova:port uuid="9c2c207b-c711-42ef-9608-cbb701d5406f">
Apr 11 23:10:53 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 23:10:53 user nova-compute[71516]:         </nova:port>
Apr 11 23:10:53 user nova-compute[71516]:       </nova:ports>
Apr 11 23:10:53 user nova-compute[71516]:     </nova:instance>
Apr 11 23:10:53 user nova-compute[71516]:   </metadata>
Apr 11 23:10:53 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:10:53 user nova-compute[71516]:     <system>
Apr 11 23:10:53 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:10:53 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:10:53 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:10:53 user nova-compute[71516]:       <entry name="serial">f2f6794f-cdcf-422e-8ae5-030fc2c3213b</entry>
Apr 11 23:10:53 user nova-compute[71516]:       <entry name="uuid">f2f6794f-cdcf-422e-8ae5-030fc2c3213b</entry>
Apr 11 23:10:53 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:10:53 user nova-compute[71516]:     </system>
Apr 11 23:10:53 user nova-compute[71516]:   </sysinfo>
Apr 11 23:10:53 user nova-compute[71516]:   <os>
Apr 11 23:10:53 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:10:53 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:10:53 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:10:53 user nova-compute[71516]:   </os>
Apr 11 23:10:53 user nova-compute[71516]:   <features>
Apr 11 23:10:53 user nova-compute[71516]:     <acpi/>
Apr 11 23:10:53 user nova-compute[71516]:     <apic/>
Apr 11 23:10:53 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:10:53 user nova-compute[71516]:   </features>
Apr 11 23:10:53 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:10:53 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:10:53 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:10:53 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:10:53 user nova-compute[71516]:   </clock>
Apr 11 23:10:53 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:10:53 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:10:53 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:10:53 user nova-compute[71516]:   </cpu>
Apr 11 23:10:53 user nova-compute[71516]:   <devices>
Apr 11 23:10:53 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:10:53 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:10:53 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk"/>
Apr 11 23:10:53 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:10:53 user nova-compute[71516]:     </disk>
Apr 11 23:10:53 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:10:53 user nova-compute[71516]:       <mac address="fa:16:3e:74:c4:27"/>
Apr 11 23:10:53 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:10:53 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:10:53 user nova-compute[71516]:       <target dev="tap9c2c207b-c7"/>
Apr 11 23:10:53 user nova-compute[71516]:     </interface>
Apr 11 23:10:53 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:10:53 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/console.log" append="off"/>
Apr 11 23:10:53 user nova-compute[71516]:     </serial>
Apr 11 23:10:53 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:10:53 user nova-compute[71516]:     <video>
Apr 11 23:10:53 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:10:53 user nova-compute[71516]:     </video>
Apr 11 23:10:53 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:10:53 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:10:53 user nova-compute[71516]:     </rng>
Apr 11 23:10:53 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:10:53 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:10:53 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:10:53 user nova-compute[71516]:     </memballoon>
Apr 11 23:10:53 user nova-compute[71516]:   </devices>
Apr 11 23:10:53 user nova-compute[71516]: </domain>
Apr 11 23:10:53 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1566798189',display_name='tempest-AttachVolumeNegativeTest-server-1566798189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1566798189',id=20,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBMEewzXEFy6CSMxptTsXBa5J41k9pW5kYlrexIdLtOBRh01epIt7LV7EDJlwObFzREbUoeDYDcdXxxRAjnOopOEfu8u05/8uauEotW0z7ypKiOFDNzAI9D4I71bSqQGg==',key_name='tempest-keypair-871178907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f29d28c472c4f65b8437ce443d208c7',ramdisk_id='',reservation_id='r-703ls7p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2123485934',owner_user_name='tempest-AttachVolumeNegativeTest-2123485934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da1389f3e27f49f394598636d041a9c9',uuid=f2f6794f-cdcf-422e-8ae5-030fc2c3213b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c2c207b-c711-42ef-9608-cbb701d5406f", "address": "fa:16:3e:74:c4:27", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c207b-c7", "ovs_interfaceid": "9c2c207b-c711-42ef-9608-cbb701d5406f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converting VIF {"id": "9c2c207b-c711-42ef-9608-cbb701d5406f", "address": "fa:16:3e:74:c4:27", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c207b-c7", "ovs_interfaceid": "9c2c207b-c711-42ef-9608-cbb701d5406f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=9c2c207b-c711-42ef-9608-cbb701d5406f,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c207b-c7') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG os_vif [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=9c2c207b-c711-42ef-9608-cbb701d5406f,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c207b-c7') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c2c207b-c7, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c2c207b-c7, col_values=(('external_ids', {'iface-id': '9c2c207b-c711-42ef-9608-cbb701d5406f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:c4:27', 'vm-uuid': 'f2f6794f-cdcf-422e-8ae5-030fc2c3213b'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:53 user nova-compute[71516]: INFO os_vif [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=9c2c207b-c711-42ef-9608-cbb701d5406f,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c207b-c7')
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No VIF found with MAC fa:16:3e:74:c4:27, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Updated VIF entry in instance network info cache for port 9c2c207b-c711-42ef-9608-cbb701d5406f. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Updating instance_info_cache with network_info: [{"id": "9c2c207b-c711-42ef-9608-cbb701d5406f", "address": "fa:16:3e:74:c4:27", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c207b-c7", "ovs_interfaceid": "9c2c207b-c711-42ef-9608-cbb701d5406f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:10:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] Releasing lock "refresh_cache-f2f6794f-cdcf-422e-8ae5-030fc2c3213b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:10:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-3352fb38-79b6-4481-ba03-11668e4a8b6a req-d7de268a-9b3e-4eed-8aed-57757da646a1 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Received event network-vif-plugged-9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3352fb38-79b6-4481-ba03-11668e4a8b6a req-d7de268a-9b3e-4eed-8aed-57757da646a1 service nova] Acquiring lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3352fb38-79b6-4481-ba03-11668e4a8b6a req-d7de268a-9b3e-4eed-8aed-57757da646a1 service nova] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3352fb38-79b6-4481-ba03-11668e4a8b6a req-d7de268a-9b3e-4eed-8aed-57757da646a1 service nova] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-3352fb38-79b6-4481-ba03-11668e4a8b6a req-d7de268a-9b3e-4eed-8aed-57757da646a1 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] No waiting events found dispatching network-vif-plugged-9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:54 user nova-compute[71516]: WARNING nova.compute.manager [req-3352fb38-79b6-4481-ba03-11668e4a8b6a req-d7de268a-9b3e-4eed-8aed-57757da646a1 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Received unexpected event network-vif-plugged-9c2c207b-c711-42ef-9608-cbb701d5406f for instance with vm_state building and task_state spawning.
Apr 11 23:10:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254656.7735574, f2f6794f-cdcf-422e-8ae5-030fc2c3213b => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:10:56 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] VM Resumed (Lifecycle Event)
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.compute.manager [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:10:56 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Instance spawned successfully.
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:10:56 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254656.7774975, f2f6794f-cdcf-422e-8ae5-030fc2c3213b => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:10:56 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] VM Started (Lifecycle Event)
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:10:56 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:10:56 user nova-compute[71516]: INFO nova.compute.manager [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Took 5.27 seconds to spawn the instance on the hypervisor.
Apr 11 23:10:56 user nova-compute[71516]: DEBUG nova.compute.manager [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:56 user nova-compute[71516]: INFO nova.compute.manager [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Took 6.01 seconds to build instance.
Apr 11 23:10:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.121s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-d53504f8-72bc-43ac-a847-28d4ddacc7df req-da8ab6e4-f30e-4954-aa36-859409c8ad23 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Received event network-vif-plugged-9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:10:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d53504f8-72bc-43ac-a847-28d4ddacc7df req-da8ab6e4-f30e-4954-aa36-859409c8ad23 service nova] Acquiring lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:10:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d53504f8-72bc-43ac-a847-28d4ddacc7df req-da8ab6e4-f30e-4954-aa36-859409c8ad23 service nova] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:10:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d53504f8-72bc-43ac-a847-28d4ddacc7df req-da8ab6e4-f30e-4954-aa36-859409c8ad23 service nova] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:10:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-d53504f8-72bc-43ac-a847-28d4ddacc7df req-da8ab6e4-f30e-4954-aa36-859409c8ad23 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] No waiting events found dispatching network-vif-plugged-9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:10:57 user nova-compute[71516]: WARNING nova.compute.manager [req-d53504f8-72bc-43ac-a847-28d4ddacc7df req-da8ab6e4-f30e-4954-aa36-859409c8ad23 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Received unexpected event network-vif-plugged-9c2c207b-c711-42ef-9608-cbb701d5406f for instance with vm_state active and task_state None.
Apr 11 23:10:57 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254642.3907528, fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:10:57 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] VM Stopped (Lifecycle Event)
Apr 11 23:10:57 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2024a7fc-3140-4acb-a3c5-6cf7dee8116c None None] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:10:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "4f95b120-0c70-45a5-969f-c1728c72d420" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:04 user nova-compute[71516]: INFO nova.compute.manager [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Detaching volume 5d576508-63a9-4c1c-8b86-952f4522ecd4
Apr 11 23:11:04 user nova-compute[71516]: INFO nova.virt.block_device [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Attempting to driver detach volume 5d576508-63a9-4c1c-8b86-952f4522ecd4 from mountpoint /dev/vdb
Apr 11 23:11:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Attempting to detach device vdb from instance 4f95b120-0c70-45a5-969f-c1728c72d420 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:11:04 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:11:04 user nova-compute[71516]:   <source dev="/dev/sdd"/>
Apr 11 23:11:04 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:11:04 user nova-compute[71516]:   <serial>5d576508-63a9-4c1c-8b86-952f4522ecd4</serial>
Apr 11 23:11:04 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:11:04 user nova-compute[71516]: </disk>
Apr 11 23:11:04 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:11:04 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Successfully detached device vdb from instance 4f95b120-0c70-45a5-969f-c1728c72d420 from the persistent domain config.
Apr 11 23:11:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f95b120-0c70-45a5-969f-c1728c72d420 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:11:04 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:11:04 user nova-compute[71516]:   <source dev="/dev/sdd"/>
Apr 11 23:11:04 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:11:04 user nova-compute[71516]:   <serial>5d576508-63a9-4c1c-8b86-952f4522ecd4</serial>
Apr 11 23:11:04 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:11:04 user nova-compute[71516]: </disk>
Apr 11 23:11:04 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681254664.9520972, 4f95b120-0c70-45a5-969f-c1728c72d420 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:11:04 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Successfully detached device vdb from instance 4f95b120-0c70-45a5-969f-c1728c72d420 from the live domain config.
Apr 11 23:11:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYIrWqpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:11:04 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:11:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee630a9-cb45-47cc-a0f0-aeb9d7457727]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:11:04 user nova-compute[71516]: No targets found.
Apr 11 23:11:04 user nova-compute[71516]: iSNS:
Apr 11 23:11:04 user nova-compute[71516]: No targets found.
Apr 11 23:11:04 user nova-compute[71516]: STATIC:
Apr 11 23:11:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d
Apr 11 23:11:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734
Apr 11 23:11:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5
Apr 11 23:11:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68
Apr 11 23:11:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4
Apr 11 23:11:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:04 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee
Apr 11 23:11:04 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:04 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:04 user nova-compute[71516]: FIRMWARE:
Apr 11 23:11:04 user nova-compute[71516]: No targets found.
Apr 11 23:11:04 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:11:04 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:11:04 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:11:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fda726-2d5d-43a9-8e0b-c6ebb73baa00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33ac3c0-0286-4842-b1d1-2fd1c48b0333]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:11:05 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:11:05 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:11:05 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:11:05 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:11:05 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:11:05 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:11:05 user nova-compute[71516]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 (non-flash)
Apr 11 23:11:05 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:11:05 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:11:05 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:11:05 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:11:05 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c57cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4'): ({'sdd'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Removing single pathed devices sdd {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4856f040-0697-46d7-a8e1-282e146b74b4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e7429e-2489-468a-8447-7c5a5d2c12ff]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Flushing IO for device /dev/sdd {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa08738b-4448-4291-ab3a-6da1344981aa]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c19812-80af-4e6e-b7c1-d74cd8052d3b]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bde013-eaf7-48c2-b845-53962d01f268]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fd6283-0216-4239-b4df-0dad315ba6ae]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4, portal: 172.16.0.220,3260]
Apr 11 23:11:05 user nova-compute[71516]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4, portal: 172.16.0.220,3260] successful.
Apr 11 23:11:05 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d576508-63a9-4c1c-8b86-952f4522ecd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1664b1c7-601b-4862-8bcd-a6ad1947cbcb]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] <== disconnect_volume: return (364ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:11:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:06 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'flavor' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:11:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "4f95b120-0c70-45a5-969f-c1728c72d420" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.831s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:06 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254651.482106, e4d31874-4273-48bc-8811-89832d18b893 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:11:06 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] VM Stopped (Lifecycle Event)
Apr 11 23:11:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6a521f9e-62ca-40ac-aebe-4751db41a425 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:11:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6a521f9e-62ca-40ac-aebe-4751db41a425 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:11:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "8322b884-2831-48af-a67e-26c31c17f49f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:20 user nova-compute[71516]: INFO nova.compute.manager [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Terminating instance
Apr 11 23:11:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-3bfac82b-9698-4fe8-a523-248f02d4303c req-bc884acd-3615-41d2-8123-cda5cd96e635 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-vif-unplugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3bfac82b-9698-4fe8-a523-248f02d4303c req-bc884acd-3615-41d2-8123-cda5cd96e635 service nova] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3bfac82b-9698-4fe8-a523-248f02d4303c req-bc884acd-3615-41d2-8123-cda5cd96e635 service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3bfac82b-9698-4fe8-a523-248f02d4303c req-bc884acd-3615-41d2-8123-cda5cd96e635 service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-3bfac82b-9698-4fe8-a523-248f02d4303c req-bc884acd-3615-41d2-8123-cda5cd96e635 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] No waiting events found dispatching network-vif-unplugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:11:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-3bfac82b-9698-4fe8-a523-248f02d4303c req-bc884acd-3615-41d2-8123-cda5cd96e635 service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-vif-unplugged-b44a27e4-9811-4e81-8f41-c7f58def46bc for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:11:21 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Instance destroyed successfully.
Apr 11 23:11:21 user nova-compute[71516]: DEBUG nova.objects.instance [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'resources' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:11:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-742046125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-742046125',id=4,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhq2c1AASfEGyAAJl+QIGDBVlGaQd5aU2DpuWVUMd+VgtFnNGA30jaPJqm7CxuxKNS3cfyVDWuM5n3h/I+Opv2IF/BYKVBsSYfscd1VrAJJc1HvdHk6jRHnOOCv9avuqQ==',key_name='tempest-keypair-208393987',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b466a7e141a247319eae64ab30aca760',ramdisk_id='',reservation_id='r-kxb0ie0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849897654',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849897654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:09:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7272af33be864737b2231127f4323638',uuid=8322b884-2831-48af-a67e-26c31c17f49f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:11:21 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converting VIF {"id": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "address": "fa:16:3e:6a:ca:ec", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb44a27e4-98", "ovs_interfaceid": "b44a27e4-9811-4e81-8f41-c7f58def46bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:11:21 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:11:21 user nova-compute[71516]: DEBUG os_vif [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:11:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb44a27e4-98, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:11:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:11:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:21 user nova-compute[71516]: INFO os_vif [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ca:ec,bridge_name='br-int',has_traffic_filtering=True,id=b44a27e4-9811-4e81-8f41-c7f58def46bc,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb44a27e4-98')
Apr 11 23:11:21 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Deleting instance files /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f_del
Apr 11 23:11:21 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Deletion of /opt/stack/data/nova/instances/8322b884-2831-48af-a67e-26c31c17f49f_del complete
Apr 11 23:11:21 user nova-compute[71516]: INFO nova.compute.manager [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 11 23:11:21 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:11:21 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:11:21 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:11:21 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:11:22 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Took 0.65 seconds to deallocate network for instance.
Apr 11 23:11:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:22 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:11:22 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:11:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:22 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Deleted allocations for instance 8322b884-2831-48af-a67e-26c31c17f49f
Apr 11 23:11:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "8322b884-2831-48af-a67e-26c31c17f49f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:11:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] Acquiring lock "8322b884-2831-48af-a67e-26c31c17f49f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] Lock "8322b884-2831-48af-a67e-26c31c17f49f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] No waiting events found dispatching network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:11:22 user nova-compute[71516]: WARNING nova.compute.manager [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received unexpected event network-vif-plugged-b44a27e4-9811-4e81-8f41-c7f58def46bc for instance with vm_state deleted and task_state None.
Apr 11 23:11:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Received event network-vif-deleted-b44a27e4-9811-4e81-8f41-c7f58def46bc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:11:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "a95ec17c-3200-4f51-be89-116ee3306968" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "a95ec17c-3200-4f51-be89-116ee3306968" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG nova.objects.instance [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lazy-loading 'flavor' on Instance uuid a95ec17c-3200-4f51-be89-116ee3306968 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "a95ec17c-3200-4f51-be89-116ee3306968" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "a95ec17c-3200-4f51-be89-116ee3306968" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "a95ec17c-3200-4f51-be89-116ee3306968" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:25 user nova-compute[71516]: INFO nova.compute.manager [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Attaching volume e013f26d-7deb-40df-9cbf-4a61c6549ac7 to /dev/vdb
Apr 11 23:11:25 user nova-compute[71516]: DEBUG os_brick.utils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3fb415-c194-495a-b29d-bdcf8cd85024]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a980182-dc65-475e-8261-91b6c2039fd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f08ce1-1fc8-4173-8ca0-b8de5c08da4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4872fc9-d36a-4cfb-a07e-8ee87b78f02c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:11:25 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:11:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[762a20d9-c98e-4b4a-aeda-b90351db2b51]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG os_brick.utils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:11:25 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Updating existing volume attachment record: cee682d7-1ee7-4929-8b8e-fb8a6acd6413 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:11:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:27 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:11:27 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:11:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:11:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:11:27 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:11:27 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updating instance_info_cache with network_info: [{"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:11:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-4f95b120-0c70-45a5-969f-c1728c72d420" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:11:27 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozbVCdWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:11:30 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:11:30 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:11:30 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[625e1273-32b5-4b0d-903c-09529251b497]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:11:30 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85ca295-0afb-481b-9276-0bcbb88f546b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7] added
Apr 11 23:11:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedd52e9-6826-4eed-a556-8666090f4b7b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1fe6c5-2525-408e-b5d1-6f968f15b19b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozbVCdWT {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozbVCdWT" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bd0dae-52c1-4de1-b395-95dfba216017]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ozbVCdWT'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7564c6-16a2-4be4-8592-fcbead9760b7]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd2eab9-cc73-4207-8582-00a0a72910bc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db1baa0-b612-4f87-878e-4653608b2a8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7, portal: 172.16.0.220,3260]
Apr 11 23:11:30 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7, portal: 172.16.0.220,3260] successful.
Apr 11 23:11:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb35e97f-41fd-4113-81ba-06db9a728202]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96a8749-846c-47c6-9083-0247c117fc81]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 (non-flash)
Apr 11 23:11:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ce309c-b57e-4e3b-ac2a-d15a21687a1f]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: None {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:11:31 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:11:31 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=7651MB free_disk=26.289398193359375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 4f95b120-0c70-45a5-969f-c1728c72d420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f2a79a44-800e-4142-b778-aae06a5c779d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e4d31874-4273-48bc-8811-89832d18b893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance a95ec17c-3200-4f51-be89-116ee3306968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 039fb13b-89bc-493c-af37-9f261ab5c077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozbVCdWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26365343464396534', 'path': '/dev/sdd'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365343464396534', 'path': '/dev/sdd'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.objects.instance [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lazy-loading 'flavor' on Instance uuid a95ec17c-3200-4f51-be89-116ee3306968 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:11:31 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:11:31 user nova-compute[71516]:   <source dev="/dev/sdd"/>
Apr 11 23:11:31 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:11:31 user nova-compute[71516]:   <serial>e013f26d-7deb-40df-9cbf-4a61c6549ac7</serial>
Apr 11 23:11:31 user nova-compute[71516]: </disk>
Apr 11 23:11:31 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:31 user nova-compute[71516]: INFO nova.compute.manager [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Detaching volume 5f2d798b-8277-4bd3-a36e-dd47771c3f8d
Apr 11 23:11:31 user nova-compute[71516]: INFO nova.virt.block_device [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Attempting to driver detach volume 5f2d798b-8277-4bd3-a36e-dd47771c3f8d from mountpoint /dev/vdb
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Attempting to detach device vdb from instance eed8cea5-9e5c-4467-8993-456cb3235fd8 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:11:31 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:11:31 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:11:31 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:11:31 user nova-compute[71516]:   <serial>5f2d798b-8277-4bd3-a36e-dd47771c3f8d</serial>
Apr 11 23:11:31 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 23:11:31 user nova-compute[71516]: </disk>
Apr 11 23:11:31 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:11:31 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully detached device vdb from instance eed8cea5-9e5c-4467-8993-456cb3235fd8 from the persistent domain config.
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eed8cea5-9e5c-4467-8993-456cb3235fd8 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:11:31 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:11:31 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:11:31 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:11:31 user nova-compute[71516]:   <serial>5f2d798b-8277-4bd3-a36e-dd47771c3f8d</serial>
Apr 11 23:11:31 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 23:11:31 user nova-compute[71516]: </disk>
Apr 11 23:11:31 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:11:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] No VIF found with MAC fa:16:3e:d4:7a:63, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "a95ec17c-3200-4f51-be89-116ee3306968" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.408s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681254692.0604184, eed8cea5-9e5c-4467-8993-456cb3235fd8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:11:32 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully detached device vdb from instance eed8cea5-9e5c-4467-8993-456cb3235fd8 from the live domain config.
Apr 11 23:11:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAYIUBMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:11:32 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f9ea3c-030b-414b-b10f-ae149d705ee5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:11:32 user nova-compute[71516]: No targets found.
Apr 11 23:11:32 user nova-compute[71516]: iSNS:
Apr 11 23:11:32 user nova-compute[71516]: No targets found.
Apr 11 23:11:32 user nova-compute[71516]: STATIC:
Apr 11 23:11:32 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d
Apr 11 23:11:32 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:32 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:32 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7
Apr 11 23:11:32 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:32 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:32 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734
Apr 11 23:11:32 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:32 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:32 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5
Apr 11 23:11:32 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:32 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:32 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68
Apr 11 23:11:32 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:32 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:32 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee
Apr 11 23:11:32 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:32 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:32 user nova-compute[71516]: FIRMWARE:
Apr 11 23:11:32 user nova-compute[71516]: No targets found.
Apr 11 23:11:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:11:32 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:11:32 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d3e687-d460-482c-90ea-d1959e2a4144]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c40b014-70b2-4b8d-8492-9d34751e7118]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:11:32 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:11:32 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:11:32 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:11:32 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:11:32 user nova-compute[71516]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 (non-flash)
Apr 11 23:11:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:11:32 user nova-compute[71516]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d (non-flash)
Apr 11 23:11:32 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:11:32 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:11:32 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:11:32 user nova-compute[71516]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 (non-flash)
Apr 11 23:11:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c430700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3adb658-2f3d-4289-8500-332e972c079f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47051e0-f099-4054-9944-3e4ada63fd6d]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[526b9316-0330-4ca1-b74d-0239520a9069]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[987f9551-fd82-4f60-b323-f132fa378786]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "a95ec17c-3200-4f51-be89-116ee3306968" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "a95ec17c-3200-4f51-be89-116ee3306968" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "a95ec17c-3200-4f51-be89-116ee3306968-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "a95ec17c-3200-4f51-be89-116ee3306968-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "a95ec17c-3200-4f51-be89-116ee3306968-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:32 user nova-compute[71516]: INFO nova.compute.manager [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Terminating instance
Apr 11 23:11:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[09882142-d970-4601-8e50-aff87903e4d6]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2fecf0-82bc-4c38-8736-da314723ed15]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260]
Apr 11 23:11:32 user nova-compute[71516]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d, portal: 172.16.0.220,3260] successful.
Apr 11 23:11:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d798b-8277-4bd3-a36e-dd47771c3f8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[69baf33c-b4dd-4efa-9994-ecf5ffa0b7c3]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== disconnect_volume: return (356ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG nova.compute.manager [req-96d6bc08-ca13-4de7-b2e5-bcf77229cdd1 req-23e2ac3b-3220-4d05-8cf5-7399a0e7a5c2 service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Received event network-vif-unplugged-e40ede4c-bd9e-4e65-bc15-6320fcd5134a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96d6bc08-ca13-4de7-b2e5-bcf77229cdd1 req-23e2ac3b-3220-4d05-8cf5-7399a0e7a5c2 service nova] Acquiring lock "a95ec17c-3200-4f51-be89-116ee3306968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96d6bc08-ca13-4de7-b2e5-bcf77229cdd1 req-23e2ac3b-3220-4d05-8cf5-7399a0e7a5c2 service nova] Lock "a95ec17c-3200-4f51-be89-116ee3306968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96d6bc08-ca13-4de7-b2e5-bcf77229cdd1 req-23e2ac3b-3220-4d05-8cf5-7399a0e7a5c2 service nova] Lock "a95ec17c-3200-4f51-be89-116ee3306968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG nova.compute.manager [req-96d6bc08-ca13-4de7-b2e5-bcf77229cdd1 req-23e2ac3b-3220-4d05-8cf5-7399a0e7a5c2 service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] No waiting events found dispatching network-vif-unplugged-e40ede4c-bd9e-4e65-bc15-6320fcd5134a {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG nova.compute.manager [req-96d6bc08-ca13-4de7-b2e5-bcf77229cdd1 req-23e2ac3b-3220-4d05-8cf5-7399a0e7a5c2 service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Received event network-vif-unplugged-e40ede4c-bd9e-4e65-bc15-6320fcd5134a for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:11:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:11:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Instance destroyed successfully.
Apr 11 23:11:33 user nova-compute[71516]: DEBUG nova.objects.instance [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lazy-loading 'resources' on Instance uuid a95ec17c-3200-4f51-be89-116ee3306968 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1735343577',display_name='tempest-DeleteServersTestJSON-server-1735343577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1735343577',id=17,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:09:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db2b607b5736495895de9c423eeb7443',ramdisk_id='',reservation_id='r-f62sbttp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1854468270',owner_user_name='tempest-DeleteServersTestJSON-1854468270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:09:41Z,user_data=None,user_id='190187c84d9a42e4a6f6e2a834cae8eb',uuid=a95ec17c-3200-4f51-be89-116ee3306968,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "address": "fa:16:3e:d4:7a:63", "network": {"id": "3b8208aa-b1fb-4696-a19a-fde2229542d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-687348258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b607b5736495895de9c423eeb7443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape40ede4c-bd", "ovs_interfaceid": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Converting VIF {"id": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "address": "fa:16:3e:d4:7a:63", "network": {"id": "3b8208aa-b1fb-4696-a19a-fde2229542d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-687348258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b607b5736495895de9c423eeb7443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape40ede4c-bd", "ovs_interfaceid": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=e40ede4c-bd9e-4e65-bc15-6320fcd5134a,network=Network(3b8208aa-b1fb-4696-a19a-fde2229542d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40ede4c-bd') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_vif [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=e40ede4c-bd9e-4e65-bc15-6320fcd5134a,network=Network(3b8208aa-b1fb-4696-a19a-fde2229542d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40ede4c-bd') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape40ede4c-bd, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:33 user nova-compute[71516]: INFO os_vif [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=e40ede4c-bd9e-4e65-bc15-6320fcd5134a,network=Network(3b8208aa-b1fb-4696-a19a-fde2229542d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40ede4c-bd')
Apr 11 23:11:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozbVCdWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:11:33 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[87286782-298e-4668-bb13-060fc9c371a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:11:33 user nova-compute[71516]: No targets found.
Apr 11 23:11:33 user nova-compute[71516]: iSNS:
Apr 11 23:11:33 user nova-compute[71516]: No targets found.
Apr 11 23:11:33 user nova-compute[71516]: STATIC:
Apr 11 23:11:33 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7
Apr 11 23:11:33 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:33 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:33 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734
Apr 11 23:11:33 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:33 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:33 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5
Apr 11 23:11:33 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:33 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:33 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68
Apr 11 23:11:33 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:33 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:33 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee
Apr 11 23:11:33 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:11:33 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:11:33 user nova-compute[71516]: FIRMWARE:
Apr 11 23:11:33 user nova-compute[71516]: No targets found.
Apr 11 23:11:33 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:11:33 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:11:33 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d6cc09-4e13-4c2e-a4ec-0cc6c7341d24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c389bac6-aa43-4039-bfe8-d9204106f655]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:11:33 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:11:33 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:11:33 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:11:33 user nova-compute[71516]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 (non-flash)
Apr 11 23:11:33 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:11:33 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:11:33 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:11:33 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:11:33 user nova-compute[71516]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 (non-flash)
Apr 11 23:11:33 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c184a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7'): ({'sdd'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Removing single pathed devices sdd {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5b2c01-9a75-478f-a52d-01169ad94fce]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be27777-80ce-4a57-a94c-fb0fa3b34f24]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Flushing IO for device /dev/sdd {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[333f9540-41f2-4363-a144-94d2d320d72e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4764eea-6b29-49f5-8b3b-5bc29b24cb4c]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG nova.objects.instance [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'flavor' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c9836c-accd-4b25-ad8c-a71278764b02]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.878s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c9c658-f3c2-4a49-873a-7d7b9edc0199]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7, portal: 172.16.0.220,3260]
Apr 11 23:11:33 user nova-compute[71516]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7, portal: 172.16.0.220,3260] successful.
Apr 11 23:11:33 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e013f26d-7deb-40df-9cbf-4a61c6549ac7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[86add7aa-0c69-43fe-a022-6ae6d7b7cfde]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] <== disconnect_volume: return (308ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:11:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Deleting instance files /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968_del
Apr 11 23:11:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Deletion of /opt/stack/data/nova/instances/a95ec17c-3200-4f51-be89-116ee3306968_del complete
Apr 11 23:11:33 user nova-compute[71516]: INFO nova.compute.manager [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 11 23:11:33 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: a95ec17c-3200-4f51-be89-116ee3306968] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:11:33 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:11:33 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Took 0.46 seconds to deallocate network for instance.
Apr 11 23:11:33 user nova-compute[71516]: DEBUG nova.compute.manager [req-fd121bc5-1409-4a6d-b7d0-d6017bfa55e9 req-31a67503-9295-4b7d-b877-20b3ef0a105e service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Received event network-vif-deleted-e40ede4c-bd9e-4e65-bc15-6320fcd5134a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:11:34 user nova-compute[71516]: DEBUG nova.compute.manager [req-3ba192f0-8133-459c-8f39-7df46f731e40 req-1de9d528-2bae-4b3f-86ce-39b88bb66ade service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Received event network-vif-plugged-e40ede4c-bd9e-4e65-bc15-6320fcd5134a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:11:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3ba192f0-8133-459c-8f39-7df46f731e40 req-1de9d528-2bae-4b3f-86ce-39b88bb66ade service nova] Acquiring lock "a95ec17c-3200-4f51-be89-116ee3306968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3ba192f0-8133-459c-8f39-7df46f731e40 req-1de9d528-2bae-4b3f-86ce-39b88bb66ade service nova] Lock "a95ec17c-3200-4f51-be89-116ee3306968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3ba192f0-8133-459c-8f39-7df46f731e40 req-1de9d528-2bae-4b3f-86ce-39b88bb66ade service nova] Lock "a95ec17c-3200-4f51-be89-116ee3306968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:34 user nova-compute[71516]: DEBUG nova.compute.manager [req-3ba192f0-8133-459c-8f39-7df46f731e40 req-1de9d528-2bae-4b3f-86ce-39b88bb66ade service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] No waiting events found dispatching network-vif-plugged-e40ede4c-bd9e-4e65-bc15-6320fcd5134a {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:11:34 user nova-compute[71516]: WARNING nova.compute.manager [req-3ba192f0-8133-459c-8f39-7df46f731e40 req-1de9d528-2bae-4b3f-86ce-39b88bb66ade service nova] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Received unexpected event network-vif-plugged-e40ede4c-bd9e-4e65-bc15-6320fcd5134a for instance with vm_state active and task_state deleting.
Apr 11 23:11:34 user nova-compute[71516]: INFO nova.compute.manager [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Took 0.77 seconds to detach 1 volumes for instance.
Apr 11 23:11:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:35 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:11:35 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:11:35 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:11:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:35 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Deleted allocations for instance a95ec17c-3200-4f51-be89-116ee3306968
Apr 11 23:11:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "a95ec17c-3200-4f51-be89-116ee3306968" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.011s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:36 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254681.2413652, 8322b884-2831-48af-a67e-26c31c17f49f => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:11:36 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] VM Stopped (Lifecycle Event)
Apr 11 23:11:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b1dcdff0-f3cd-48f3-b083-2d3313fdd23d None None] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:11:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:48 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254693.0793695, a95ec17c-3200-4f51-be89-116ee3306968 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:11:48 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: a95ec17c-3200-4f51-be89-116ee3306968] VM Stopped (Lifecycle Event)
Apr 11 23:11:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-21eda7c2-142b-4229-8da7-8e93b91c1e51 None None] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:11:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:11:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:11:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:11:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:11:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "4f95b120-0c70-45a5-969f-c1728c72d420" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:57 user nova-compute[71516]: INFO nova.compute.manager [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Terminating instance
Apr 11 23:11:57 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-01d141d6-5a07-4aa5-8f15-a8f19d7d417a req-6fe41142-3ab6-42ac-999b-c174bedaa04c service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-unplugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-01d141d6-5a07-4aa5-8f15-a8f19d7d417a req-6fe41142-3ab6-42ac-999b-c174bedaa04c service nova] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-01d141d6-5a07-4aa5-8f15-a8f19d7d417a req-6fe41142-3ab6-42ac-999b-c174bedaa04c service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-01d141d6-5a07-4aa5-8f15-a8f19d7d417a req-6fe41142-3ab6-42ac-999b-c174bedaa04c service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-01d141d6-5a07-4aa5-8f15-a8f19d7d417a req-6fe41142-3ab6-42ac-999b-c174bedaa04c service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] No waiting events found dispatching network-vif-unplugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-01d141d6-5a07-4aa5-8f15-a8f19d7d417a req-6fe41142-3ab6-42ac-999b-c174bedaa04c service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-unplugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:11:57 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Instance destroyed successfully.
Apr 11 23:11:57 user nova-compute[71516]: DEBUG nova.objects.instance [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'resources' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:04:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-229868185',display_name='tempest-ServerStableDeviceRescueTest-server-229868185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-229868185',id=3,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE9QDWoeyAk5NPp++qY0mw94h70wgQ85QXWkrvjtaSwwpbB/vlw81NpI+lMUuo71+oPbM1g+FT373UgIfaZ8VyRJDzOgtgdrI0cP+MdyqWrhTvd1yMzfPZXk/mcG9NWEw==',key_name='tempest-keypair-24963563',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:08:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8550fae43fa54d9a99dedf1d8e3bf0d0',ramdisk_id='',reservation_id='r-wtsmu0zf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2037080891',owner_user_name='tempest-ServerStableDeviceRescueTest-2037080891-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9e926b3053c4258a3340d19ae40a7a9',uuid=4f95b120-0c70-45a5-969f-c1728c72d420,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Converting VIF {"id": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "address": "fa:16:3e:24:ca:37", "network": {"id": "a4b59436-3706-4c0a-97c0-b11230ce2ee4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1751988970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8550fae43fa54d9a99dedf1d8e3bf0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a130357-a9", "ovs_interfaceid": "7a130357-a93e-4aad-8404-d4b5b8dd7022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:ca:37,bridge_name='br-int',has_traffic_filtering=True,id=7a130357-a93e-4aad-8404-d4b5b8dd7022,network=Network(a4b59436-3706-4c0a-97c0-b11230ce2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a130357-a9') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG os_vif [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:ca:37,bridge_name='br-int',has_traffic_filtering=True,id=7a130357-a93e-4aad-8404-d4b5b8dd7022,network=Network(a4b59436-3706-4c0a-97c0-b11230ce2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a130357-a9') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a130357-a9, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:11:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:11:57 user nova-compute[71516]: INFO os_vif [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:ca:37,bridge_name='br-int',has_traffic_filtering=True,id=7a130357-a93e-4aad-8404-d4b5b8dd7022,network=Network(a4b59436-3706-4c0a-97c0-b11230ce2ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a130357-a9')
Apr 11 23:11:57 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Deleting instance files /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420_del
Apr 11 23:11:57 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Deletion of /opt/stack/data/nova/instances/4f95b120-0c70-45a5-969f-c1728c72d420_del complete
Apr 11 23:11:58 user nova-compute[71516]: INFO nova.compute.manager [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 23:11:58 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:11:58 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:11:58 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:11:58 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:11:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-955c7307-2c4b-4408-a64b-4ede787eb46e req-4771ddef-aa19-482d-a5ab-8560cdc9e2dc service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-deleted-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:11:58 user nova-compute[71516]: INFO nova.compute.manager [req-955c7307-2c4b-4408-a64b-4ede787eb46e req-4771ddef-aa19-482d-a5ab-8560cdc9e2dc service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Neutron deleted interface 7a130357-a93e-4aad-8404-d4b5b8dd7022; detaching it from the instance and deleting it from the info cache
Apr 11 23:11:58 user nova-compute[71516]: DEBUG nova.network.neutron [req-955c7307-2c4b-4408-a64b-4ede787eb46e req-4771ddef-aa19-482d-a5ab-8560cdc9e2dc service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:11:58 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Took 0.75 seconds to deallocate network for instance.
Apr 11 23:11:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-955c7307-2c4b-4408-a64b-4ede787eb46e req-4771ddef-aa19-482d-a5ab-8560cdc9e2dc service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Detach interface failed, port_id=7a130357-a93e-4aad-8404-d4b5b8dd7022, reason: Instance 4f95b120-0c70-45a5-969f-c1728c72d420 could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:11:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:59 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:11:59 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:11:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:59 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Deleted allocations for instance 4f95b120-0c70-45a5-969f-c1728c72d420
Apr 11 23:11:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "4f95b120-0c70-45a5-969f-c1728c72d420" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.128s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-ef0f837c-a83e-4d67-ae18-0c9ab3b85dc8 req-d8903a52-262a-40b8-8fb7-1008fc58fb57 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:11:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ef0f837c-a83e-4d67-ae18-0c9ab3b85dc8 req-d8903a52-262a-40b8-8fb7-1008fc58fb57 service nova] Acquiring lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ef0f837c-a83e-4d67-ae18-0c9ab3b85dc8 req-d8903a52-262a-40b8-8fb7-1008fc58fb57 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ef0f837c-a83e-4d67-ae18-0c9ab3b85dc8 req-d8903a52-262a-40b8-8fb7-1008fc58fb57 service nova] Lock "4f95b120-0c70-45a5-969f-c1728c72d420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-ef0f837c-a83e-4d67-ae18-0c9ab3b85dc8 req-d8903a52-262a-40b8-8fb7-1008fc58fb57 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] No waiting events found dispatching network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:11:59 user nova-compute[71516]: WARNING nova.compute.manager [req-ef0f837c-a83e-4d67-ae18-0c9ab3b85dc8 req-d8903a52-262a-40b8-8fb7-1008fc58fb57 service nova] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Received unexpected event network-vif-plugged-7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance with vm_state deleted and task_state None.
Apr 11 23:11:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "039fb13b-89bc-493c-af37-9f261ab5c077" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "039fb13b-89bc-493c-af37-9f261ab5c077" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:11:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:11:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:11:59 user nova-compute[71516]: INFO nova.compute.manager [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Terminating instance
Apr 11 23:11:59 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:11:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:00 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Instance destroyed successfully.
Apr 11 23:12:00 user nova-compute[71516]: DEBUG nova.objects.instance [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lazy-loading 'resources' on Instance uuid 039fb13b-89bc-493c-af37-9f261ab5c077 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-520243177',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-520243177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-520243177',id=18,image_ref='17af8c22-c9d1-475f-8a37-adcc7b531013',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-icch06pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-365588456',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:10:26Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=039fb13b-89bc-493c-af37-9f261ab5c077,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05e7023b-90b4-42fb-a20d-554820d2afea", "address": "fa:16:3e:f6:97:13", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e7023b-90", "ovs_interfaceid": "05e7023b-90b4-42fb-a20d-554820d2afea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "05e7023b-90b4-42fb-a20d-554820d2afea", "address": "fa:16:3e:f6:97:13", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e7023b-90", "ovs_interfaceid": "05e7023b-90b4-42fb-a20d-554820d2afea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:97:13,bridge_name='br-int',has_traffic_filtering=True,id=05e7023b-90b4-42fb-a20d-554820d2afea,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e7023b-90') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_vif [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:97:13,bridge_name='br-int',has_traffic_filtering=True,id=05e7023b-90b4-42fb-a20d-554820d2afea,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e7023b-90') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05e7023b-90, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:00 user nova-compute[71516]: INFO os_vif [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:97:13,bridge_name='br-int',has_traffic_filtering=True,id=05e7023b-90b4-42fb-a20d-554820d2afea,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e7023b-90')
Apr 11 23:12:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFBJCwGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:12:00 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2f0145-448c-47d4-aa1e-9260083303ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:12:00 user nova-compute[71516]: No targets found.
Apr 11 23:12:00 user nova-compute[71516]: iSNS:
Apr 11 23:12:00 user nova-compute[71516]: No targets found.
Apr 11 23:12:00 user nova-compute[71516]: STATIC:
Apr 11 23:12:00 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734
Apr 11 23:12:00 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:00 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:00 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5
Apr 11 23:12:00 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:00 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:00 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68
Apr 11 23:12:00 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:00 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:00 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee
Apr 11 23:12:00 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:00 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:00 user nova-compute[71516]: FIRMWARE:
Apr 11 23:12:00 user nova-compute[71516]: No targets found.
Apr 11 23:12:00 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:12:00 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:12:00 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa65839-da3e-45f4-81b7-0ff6b9fa7b8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[43375b1c-f8f3-4612-b945-cb59a38af9d5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:00 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:12:00 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:00 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:00 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:00 user nova-compute[71516]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 (non-flash)
Apr 11 23:12:00 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:00 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:00 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c430ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734'): ({'sdf'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Removing single pathed devices sdf {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0c30ca-1c0d-451f-9d8c-dfbe4539e8ee]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b92e57-e5ae-4f59-8ec8-c9418297432e]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flushing IO for device /dev/sdf {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f20b8cf-b613-402e-93a6-e7e7cfa5442c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'flavor' on Instance uuid 80d81d49-127b-4bc7-aefc-1ba1678394c9 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa41be7c-0fb8-4d26-8271-01f652fa53fb]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] SCSI volumes sdf have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b97941d3', '/dev/disk/by-id/scsi-1SCST_BIOb97941d3-d0f5dae8a2554213', '/dev/disk/by-id/scsi-26430663564616538') {{(pid=81691) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b86b3f4-e5df-4ea7-8b12-5cc5d3ed6f11]: (4, None) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:00 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Ignoring supplied device name: /dev/vdb
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbdcc85-dc46-41ef-8c25-d09202f118f0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8a3b8e-1ad2-4e53-acd4-3ab2eba0cbb7]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734, portal: 172.16.0.220,3260]
Apr 11 23:12:00 user nova-compute[71516]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734, portal: 172.16.0.220,3260] successful.
Apr 11 23:12:00 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eebf3f1-d0d0-4dc8-800a-28f15cd10734 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9368086d-5436-4deb-8283-0c0d31214e55]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== disconnect_volume: return (345ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:12:00 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Deleting instance files /opt/stack/data/nova/instances/039fb13b-89bc-493c-af37-9f261ab5c077_del
Apr 11 23:12:00 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Deletion of /opt/stack/data/nova/instances/039fb13b-89bc-493c-af37-9f261ab5c077_del complete
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:00 user nova-compute[71516]: INFO nova.compute.manager [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Attaching volume da42751e-6790-4d7e-be98-53a1c86968e7 to /dev/vdb
Apr 11 23:12:00 user nova-compute[71516]: INFO nova.compute.manager [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Took 1.24 seconds to destroy the instance on the hypervisor.
Apr 11 23:12:00 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:12:00 user nova-compute[71516]: DEBUG os_brick.utils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b00216-0915-4043-93be-0e4e14c847c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dce851e-8c82-42ce-b142-a3c7c3a2a698]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c3b66b-a164-494d-87be-006a1a2f474f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aa5749-d9d0-4924-962d-9ea2e56430c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:12:01 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[025691bb-9118-40e2-82b2-83d78036f621]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG os_brick.utils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Updating existing volume attachment record: a9df65ce-26be-4eea-8bef-eff2a0cfc870 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-69fc2d4f-22ec-4a83-a314-c0c4ee164443 req-a907d890-9d21-4939-aadf-8ccf6797f610 service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Received event network-vif-deleted-05e7023b-90b4-42fb-a20d-554820d2afea {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:01 user nova-compute[71516]: INFO nova.compute.manager [req-69fc2d4f-22ec-4a83-a314-c0c4ee164443 req-a907d890-9d21-4939-aadf-8ccf6797f610 service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Neutron deleted interface 05e7023b-90b4-42fb-a20d-554820d2afea; detaching it from the instance and deleting it from the info cache
Apr 11 23:12:01 user nova-compute[71516]: DEBUG nova.network.neutron [req-69fc2d4f-22ec-4a83-a314-c0c4ee164443 req-a907d890-9d21-4939-aadf-8ccf6797f610 service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:12:01 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Took 0.49 seconds to deallocate network for instance.
Apr 11 23:12:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-69fc2d4f-22ec-4a83-a314-c0c4ee164443 req-a907d890-9d21-4939-aadf-8ccf6797f610 service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Detach interface failed, port_id=05e7023b-90b4-42fb-a20d-554820d2afea, reason: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Received event network-vif-unplugged-05e7023b-90b4-42fb-a20d-554820d2afea {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] Acquiring lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] Lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] Lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] No waiting events found dispatching network-vif-unplugged-05e7023b-90b4-42fb-a20d-554820d2afea {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Received event network-vif-unplugged-05e7023b-90b4-42fb-a20d-554820d2afea for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Received event network-vif-plugged-05e7023b-90b4-42fb-a20d-554820d2afea {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] Acquiring lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] Lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] Lock "039fb13b-89bc-493c-af37-9f261ab5c077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] No waiting events found dispatching network-vif-plugged-05e7023b-90b4-42fb-a20d-554820d2afea {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:01 user nova-compute[71516]: WARNING nova.compute.manager [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Received unexpected event network-vif-plugged-05e7023b-90b4-42fb-a20d-554820d2afea for instance with vm_state active and task_state deleting.
Apr 11 23:12:02 user nova-compute[71516]: INFO nova.compute.manager [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Took 0.78 seconds to detach 1 volumes for instance.
Apr 11 23:12:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Deleting volume: 7eebf3f1-d0d0-4dc8-800a-28f15cd10734 {{(pid=71516) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 23:12:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:02 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:12:02 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:12:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:02 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Deleted allocations for instance 039fb13b-89bc-493c-af37-9f261ab5c077
Apr 11 23:12:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "039fb13b-89bc-493c-af37-9f261ab5c077" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.043s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZWUNpAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:12:05 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:12:05 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:12:05 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1a9881-bfb0-4a88-9413-01223c0a68a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:12:05 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8ea143-0a08-4b08-9b29-94f8a19610aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7] added
Apr 11 23:12:05 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f201d128-aed0-4f9c-beae-9f5962ddbd40]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f920809-1bb8-4c8d-af87-47909e4feae2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RZWUNpAT {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RZWUNpAT" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d712db84-ab05-4447-a1f8-c9ca044ee83b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RZWUNpAT'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbb0475-51e6-4fa4-9674-767dfd9b3cc1]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0ecca0-8541-4d7f-9330-b71d0a6f357a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:05 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:05 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:05 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:05 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:05 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:05 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bcb31b-60e6-49e6-ab89-5c6aa6fce495]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7, portal: 172.16.0.220,3260]
Apr 11 23:12:05 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7, portal: 172.16.0.220,3260] successful.
Apr 11 23:12:05 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d78742-9bed-4b25-ab00-1cf40affee68]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94cc4bf-efde-479b-9851-7e1a426cb81d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:05 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:05 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:05 user nova-compute[71516]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 (non-flash)
Apr 11 23:12:05 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:05 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:05 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:05 user nova-compute[71516]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 (non-flash)
Apr 11 23:12:05 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1c7a0c-80b3-47d3-b8ff-399ec64b28ec]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:12:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZWUNpAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:12:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:12:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23339313036643664', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:12:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339313036643664', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:12:06 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'flavor' on Instance uuid 80d81d49-127b-4bc7-aefc-1ba1678394c9 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:12:06 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:12:06 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:12:06 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:12:06 user nova-compute[71516]:   <serial>da42751e-6790-4d7e-be98-53a1c86968e7</serial>
Apr 11 23:12:06 user nova-compute[71516]: </disk>
Apr 11 23:12:06 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:12:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:12:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:12:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] No VIF found with MAC fa:16:3e:9b:30:e6, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:12:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.232s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:12:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:12 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254717.9025664, 4f95b120-0c70-45a5-969f-c1728c72d420 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:12:12 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] VM Stopped (Lifecycle Event)
Apr 11 23:12:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-f2d532bd-a542-4dd1-9620-ef29cd20a6cb None None] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:12:14 user nova-compute[71516]: INFO nova.compute.claims [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Claim successful on node user
Apr 11 23:12:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:14 user nova-compute[71516]: INFO nova.compute.manager [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Detaching volume da42751e-6790-4d7e-be98-53a1c86968e7
Apr 11 23:12:14 user nova-compute[71516]: INFO nova.virt.block_device [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Attempting to driver detach volume da42751e-6790-4d7e-be98-53a1c86968e7 from mountpoint /dev/vdb
Apr 11 23:12:14 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Attempting to detach device vdb from instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:12:14 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:12:14 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:12:14 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:12:14 user nova-compute[71516]:   <serial>da42751e-6790-4d7e-be98-53a1c86968e7</serial>
Apr 11 23:12:14 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:12:14 user nova-compute[71516]: </disk>
Apr 11 23:12:14 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:12:14 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Successfully detached device vdb from instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 from the persistent domain config.
Apr 11 23:12:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:12:14 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:12:14 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:12:14 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:12:14 user nova-compute[71516]:   <serial>da42751e-6790-4d7e-be98-53a1c86968e7</serial>
Apr 11 23:12:14 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:12:14 user nova-compute[71516]: </disk>
Apr 11 23:12:14 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:12:14 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:12:14 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:12:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.policy [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:12:15 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Creating image(s)
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "/opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "/opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "/opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681254735.3116431, 80d81d49-127b-4bc7-aefc-1ba1678394c9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:12:15 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Successfully detached device vdb from instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 from the live domain config.
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZWUNpAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:12:15 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e139af27-8e11-4a3b-88b8-6854da07765d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:12:15 user nova-compute[71516]: No targets found.
Apr 11 23:12:15 user nova-compute[71516]: iSNS:
Apr 11 23:12:15 user nova-compute[71516]: No targets found.
Apr 11 23:12:15 user nova-compute[71516]: STATIC:
Apr 11 23:12:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5
Apr 11 23:12:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68
Apr 11 23:12:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee
Apr 11 23:12:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7
Apr 11 23:12:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:15 user nova-compute[71516]: FIRMWARE:
Apr 11 23:12:15 user nova-compute[71516]: No targets found.
Apr 11 23:12:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:12:15 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:12:15 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cd9bce-6522-4a58-8cf3-c6af6906f559]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[478548a7-7c68-41f5-8d83-4b19b835b923]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:15 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:15 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:15 user nova-compute[71516]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 (non-flash)
Apr 11 23:12:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:15 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:15 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:15 user nova-compute[71516]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 (non-flash)
Apr 11 23:12:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5419dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.149s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[39505fd5-0cd0-4cb2-8d17-cfe8a4deec31]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk 1073741824" returned: 0 in 0.049s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[384d92ae-c326-4839-8940-b3104fc113f6]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254720.4940107, 039fb13b-89bc-493c-af37-9f261ab5c077 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:12:15 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] VM Stopped (Lifecycle Event)
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ade7a4d-1189-4cb9-b84d-035e80690c76]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-77a2fe06-3900-4b00-8348-4d22ab4bf18c None None] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[36849c02-7518-4a4d-88f5-8b19fc88f1b8]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d4ddf8-cf61-4b8a-b2a3-fa459aca93f0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b86b6b-ab85-4631-ad9d-ba05e14b5b41]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7, portal: 172.16.0.220,3260]
Apr 11 23:12:15 user nova-compute[71516]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7, portal: 172.16.0.220,3260] successful.
Apr 11 23:12:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a278036d-c128-4cf7-8c3b-da38f7ad979a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] <== disconnect_volume: return (399ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Cannot resize image /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'migration_context' on Instance uuid fab7f71b-57f6-415b-9d2d-262a8ec6cb03 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Successfully created port: 5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Ensure instance console log exists: /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Successfully updated port: 5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquired lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-changed-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Refreshing instance network info cache due to event network-changed-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] Acquiring lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.objects.instance [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'flavor' on Instance uuid 80d81d49-127b-4bc7-aefc-1ba1678394c9 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.891s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.763s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:16 user nova-compute[71516]: INFO nova.compute.manager [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Terminating instance
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Updating instance_info_cache with network_info: [{"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Releasing lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Instance network_info: |[{"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] Acquired lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.network.neutron [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Refreshing network info cache for port 5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Start _get_guest_xml network_info=[{"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:12:16 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:12:16 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1536485804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1536485804',id=21,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWDui0SPuSNcW3iQQT+n8CdN0Nt1xzZAZfHsKqwSiujdTOOOEDSXAwM3wlZDgrq/pjBr0c+y+HW1Zg37Jw+CuC31UFynDxv2RaP8mEcuOy82rtfiD6ySkPqukQhekjgAg==',key_name='tempest-keypair-865048007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b466a7e141a247319eae64ab30aca760',ramdisk_id='',reservation_id='r-05tlqmg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849897654',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849897654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:12:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7272af33be864737b2231127f4323638',uuid=fab7f71b-57f6-415b-9d2d-262a8ec6cb03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converting VIF {"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'pci_devices' on Instance uuid fab7f71b-57f6-415b-9d2d-262a8ec6cb03 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-d42beb24-b4ea-4b28-99ec-b61654f18bc7 req-f18419dc-b453-4a0b-a06d-447668364c89 service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Received event network-vif-unplugged-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d42beb24-b4ea-4b28-99ec-b61654f18bc7 req-f18419dc-b453-4a0b-a06d-447668364c89 service nova] Acquiring lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d42beb24-b4ea-4b28-99ec-b61654f18bc7 req-f18419dc-b453-4a0b-a06d-447668364c89 service nova] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d42beb24-b4ea-4b28-99ec-b61654f18bc7 req-f18419dc-b453-4a0b-a06d-447668364c89 service nova] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-d42beb24-b4ea-4b28-99ec-b61654f18bc7 req-f18419dc-b453-4a0b-a06d-447668364c89 service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] No waiting events found dispatching network-vif-unplugged-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-d42beb24-b4ea-4b28-99ec-b61654f18bc7 req-f18419dc-b453-4a0b-a06d-447668364c89 service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Received event network-vif-unplugged-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:12:16 user nova-compute[71516]:   <uuid>fab7f71b-57f6-415b-9d2d-262a8ec6cb03</uuid>
Apr 11 23:12:16 user nova-compute[71516]:   <name>instance-00000015</name>
Apr 11 23:12:16 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:12:16 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:12:16 user nova-compute[71516]:   <metadata>
Apr 11 23:12:16 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:12:16 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:12:16 user nova-compute[71516]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1536485804</nova:name>
Apr 11 23:12:16 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:12:16</nova:creationTime>
Apr 11 23:12:16 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:12:16 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:12:16 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:12:16 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:12:16 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:12:16 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:12:16 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:12:16 user nova-compute[71516]:       <nova:owner>
Apr 11 23:12:16 user nova-compute[71516]:         <nova:user uuid="7272af33be864737b2231127f4323638">tempest-AttachVolumeShelveTestJSON-1849897654-project-member</nova:user>
Apr 11 23:12:16 user nova-compute[71516]:         <nova:project uuid="b466a7e141a247319eae64ab30aca760">tempest-AttachVolumeShelveTestJSON-1849897654</nova:project>
Apr 11 23:12:16 user nova-compute[71516]:       </nova:owner>
Apr 11 23:12:16 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:12:16 user nova-compute[71516]:       <nova:ports>
Apr 11 23:12:16 user nova-compute[71516]:         <nova:port uuid="5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a">
Apr 11 23:12:16 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 23:12:16 user nova-compute[71516]:         </nova:port>
Apr 11 23:12:16 user nova-compute[71516]:       </nova:ports>
Apr 11 23:12:16 user nova-compute[71516]:     </nova:instance>
Apr 11 23:12:16 user nova-compute[71516]:   </metadata>
Apr 11 23:12:16 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:12:16 user nova-compute[71516]:     <system>
Apr 11 23:12:16 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:12:16 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:12:16 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:12:16 user nova-compute[71516]:       <entry name="serial">fab7f71b-57f6-415b-9d2d-262a8ec6cb03</entry>
Apr 11 23:12:16 user nova-compute[71516]:       <entry name="uuid">fab7f71b-57f6-415b-9d2d-262a8ec6cb03</entry>
Apr 11 23:12:16 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:12:16 user nova-compute[71516]:     </system>
Apr 11 23:12:16 user nova-compute[71516]:   </sysinfo>
Apr 11 23:12:16 user nova-compute[71516]:   <os>
Apr 11 23:12:16 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:12:16 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:12:16 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:12:16 user nova-compute[71516]:   </os>
Apr 11 23:12:16 user nova-compute[71516]:   <features>
Apr 11 23:12:16 user nova-compute[71516]:     <acpi/>
Apr 11 23:12:16 user nova-compute[71516]:     <apic/>
Apr 11 23:12:16 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:12:16 user nova-compute[71516]:   </features>
Apr 11 23:12:16 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:12:16 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:12:16 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:12:16 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:12:16 user nova-compute[71516]:   </clock>
Apr 11 23:12:16 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:12:16 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:12:16 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:12:16 user nova-compute[71516]:   </cpu>
Apr 11 23:12:16 user nova-compute[71516]:   <devices>
Apr 11 23:12:16 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:12:16 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:12:16 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk"/>
Apr 11 23:12:16 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:12:16 user nova-compute[71516]:     </disk>
Apr 11 23:12:16 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:12:16 user nova-compute[71516]:       <mac address="fa:16:3e:e7:9e:95"/>
Apr 11 23:12:16 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:12:16 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:12:16 user nova-compute[71516]:       <target dev="tap5f6c4dd1-5b"/>
Apr 11 23:12:16 user nova-compute[71516]:     </interface>
Apr 11 23:12:16 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:12:16 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/console.log" append="off"/>
Apr 11 23:12:16 user nova-compute[71516]:     </serial>
Apr 11 23:12:16 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:12:16 user nova-compute[71516]:     <video>
Apr 11 23:12:16 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:12:16 user nova-compute[71516]:     </video>
Apr 11 23:12:16 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:12:16 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:12:16 user nova-compute[71516]:     </rng>
Apr 11 23:12:16 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:12:16 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:12:16 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:12:16 user nova-compute[71516]:     </memballoon>
Apr 11 23:12:16 user nova-compute[71516]:   </devices>
Apr 11 23:12:16 user nova-compute[71516]: </domain>
Apr 11 23:12:16 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1536485804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1536485804',id=21,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWDui0SPuSNcW3iQQT+n8CdN0Nt1xzZAZfHsKqwSiujdTOOOEDSXAwM3wlZDgrq/pjBr0c+y+HW1Zg37Jw+CuC31UFynDxv2RaP8mEcuOy82rtfiD6ySkPqukQhekjgAg==',key_name='tempest-keypair-865048007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b466a7e141a247319eae64ab30aca760',ramdisk_id='',reservation_id='r-05tlqmg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849897654',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849897654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:12:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7272af33be864737b2231127f4323638',uuid=fab7f71b-57f6-415b-9d2d-262a8ec6cb03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converting VIF {"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG os_vif [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f6c4dd1-5b, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f6c4dd1-5b, col_values=(('external_ids', {'iface-id': '5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:9e:95', 'vm-uuid': 'fab7f71b-57f6-415b-9d2d-262a8ec6cb03'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:12:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:16 user nova-compute[71516]: INFO os_vif [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b')
Apr 11 23:12:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:12:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] No VIF found with MAC fa:16:3e:e7:9e:95, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:12:17 user nova-compute[71516]: DEBUG nova.network.neutron [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Updated VIF entry in instance network info cache for port 5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:12:17 user nova-compute[71516]: DEBUG nova.network.neutron [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Updating instance_info_cache with network_info: [{"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:12:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] Releasing lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:12:17 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Instance destroyed successfully.
Apr 11 23:12:17 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'resources' on Instance uuid 80d81d49-127b-4bc7-aefc-1ba1678394c9 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1327390659',display_name='tempest-VolumesSnapshotTestJSON-instance-1327390659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1327390659',id=19,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='154fad18f802436d95b15503e470d942',ramdisk_id='',reservation_id='r-tdd9gwaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-76917881',owner_user_name='tempest-VolumesSnapshotTestJSON-76917881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:10:18Z,user_data=None,user_id='e3995d8045154666b0ae890dd3de5ef3',uuid=80d81d49-127b-4bc7-aefc-1ba1678394c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "address": "fa:16:3e:9b:30:e6", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5e73f7-90", "ovs_interfaceid": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:12:17 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Converting VIF {"id": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "address": "fa:16:3e:9b:30:e6", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5e73f7-90", "ovs_interfaceid": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:12:17 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:30:e6,bridge_name='br-int',has_traffic_filtering=True,id=fa5e73f7-905e-4a69-bd98-a9b5dcbd6785,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5e73f7-90') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:12:17 user nova-compute[71516]: DEBUG os_vif [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:30:e6,bridge_name='br-int',has_traffic_filtering=True,id=fa5e73f7-905e-4a69-bd98-a9b5dcbd6785,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5e73f7-90') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:12:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa5e73f7-90, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:18 user nova-compute[71516]: INFO os_vif [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:30:e6,bridge_name='br-int',has_traffic_filtering=True,id=fa5e73f7-905e-4a69-bd98-a9b5dcbd6785,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5e73f7-90')
Apr 11 23:12:18 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZWUNpAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:12:18 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:12:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[21df19d6-2288-4c85-9cf2-9f9e3d8c7b7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:12:18 user nova-compute[71516]: No targets found.
Apr 11 23:12:18 user nova-compute[71516]: iSNS:
Apr 11 23:12:18 user nova-compute[71516]: No targets found.
Apr 11 23:12:18 user nova-compute[71516]: STATIC:
Apr 11 23:12:18 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5
Apr 11 23:12:18 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:18 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:18 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68
Apr 11 23:12:18 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:18 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:18 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee
Apr 11 23:12:18 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:18 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:18 user nova-compute[71516]: FIRMWARE:
Apr 11 23:12:18 user nova-compute[71516]: No targets found.
Apr 11 23:12:18 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:12:18 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:12:18 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da42751e-6790-4d7e-be98-53a1c86968e7', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58dfaf5-03bc-4a70-bcc3-dece12079621]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb966cbd-d157-4eea-8ad6-dbf3e78713dd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:18 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:18 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:18 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:18 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:18 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:18 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e4c62d900>, {}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Disconnecting from: [] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] <== disconnect_volume: return (76ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:12:18 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Deleting instance files /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9_del
Apr 11 23:12:18 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Deletion of /opt/stack/data/nova/instances/80d81d49-127b-4bc7-aefc-1ba1678394c9_del complete
Apr 11 23:12:18 user nova-compute[71516]: INFO nova.compute.manager [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Took 1.54 seconds to destroy the instance on the hypervisor.
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:18 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Took 0.52 seconds to deallocate network for instance.
Apr 11 23:12:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-554b3bbe-5143-4fa9-956f-3877d4398b28 req-55b0e370-5be6-450e-9729-bb37d9de89cc service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Received event network-vif-deleted-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:18 user nova-compute[71516]: WARNING nova.volume.cinder [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Attachment a9df65ce-26be-4eea-8bef-eff2a0cfc870 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a9df65ce-26be-4eea-8bef-eff2a0cfc870. (HTTP 404) (Request-ID: req-4148f841-e382-4678-9758-e26ef110b999)
Apr 11 23:12:18 user nova-compute[71516]: INFO nova.compute.manager [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Took 0.03 seconds to detach 1 volumes for instance.
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-9d86d47e-b77b-4053-8d37-d3fe13238361 req-4a1d842e-9208-49e1-aaef-a0980bf31b1b service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Received event network-vif-plugged-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9d86d47e-b77b-4053-8d37-d3fe13238361 req-4a1d842e-9208-49e1-aaef-a0980bf31b1b service nova] Acquiring lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9d86d47e-b77b-4053-8d37-d3fe13238361 req-4a1d842e-9208-49e1-aaef-a0980bf31b1b service nova] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9d86d47e-b77b-4053-8d37-d3fe13238361 req-4a1d842e-9208-49e1-aaef-a0980bf31b1b service nova] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-9d86d47e-b77b-4053-8d37-d3fe13238361 req-4a1d842e-9208-49e1-aaef-a0980bf31b1b service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] No waiting events found dispatching network-vif-plugged-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:18 user nova-compute[71516]: WARNING nova.compute.manager [req-9d86d47e-b77b-4053-8d37-d3fe13238361 req-4a1d842e-9208-49e1-aaef-a0980bf31b1b service nova] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Received unexpected event network-vif-plugged-fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 for instance with vm_state deleted and task_state None.
Apr 11 23:12:19 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:12:19 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:12:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:19 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Deleted allocations for instance 80d81d49-127b-4bc7-aefc-1ba1678394c9
Apr 11 23:12:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "80d81d49-127b-4bc7-aefc-1ba1678394c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.590s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254740.7048814, fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:12:20 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] VM Resumed (Lifecycle Event)
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:12:20 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Instance spawned successfully.
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] Acquiring lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] No waiting events found dispatching network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:20 user nova-compute[71516]: WARNING nova.compute.manager [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received unexpected event network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance with vm_state building and task_state spawning.
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] Acquiring lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] No waiting events found dispatching network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:20 user nova-compute[71516]: WARNING nova.compute.manager [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received unexpected event network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance with vm_state building and task_state spawning.
Apr 11 23:12:20 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254740.70623, fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:12:20 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] VM Started (Lifecycle Event)
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:12:20 user nova-compute[71516]: INFO nova.compute.manager [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Took 5.70 seconds to spawn the instance on the hypervisor.
Apr 11 23:12:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:12:20 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:12:20 user nova-compute[71516]: INFO nova.compute.manager [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Took 6.41 seconds to build instance.
Apr 11 23:12:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.508s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:12:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Updating instance_info_cache with network_info: [{"id": "138c5b33-78b0-4ca8-a952-7be3e230441b", "address": "fa:16:3e:b4:8e:33", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138c5b33-78", "ovs_interfaceid": "138c5b33-78b0-4ca8-a952-7be3e230441b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:12:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:12:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:12:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:31 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:12:31 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:12:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8165MB free_disk=26.405811309814453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f2a79a44-800e-4142-b778-aae06a5c779d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e4d31874-4273-48bc-8811-89832d18b893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:12:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:12:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:12:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:12:32 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254737.9682808, 80d81d49-127b-4bc7-aefc-1ba1678394c9 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:12:32 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] VM Stopped (Lifecycle Event)
Apr 11 23:12:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-64a9997d-d509-4710-9359-d89b2b5292a1 None None] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:12:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:12:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:12:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:12:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:12:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:12:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:12:34 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:12:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:12:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:37 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:12:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:41 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'flavor' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:12:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquired lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:12:41 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:12:41 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'info_cache' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Received event network-changed-9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Refreshing instance network info cache due to event network-changed-9c2c207b-c711-42ef-9608-cbb701d5406f. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:12:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] Acquiring lock "refresh_cache-f2f6794f-cdcf-422e-8ae5-030fc2c3213b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:12:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] Acquired lock "refresh_cache-f2f6794f-cdcf-422e-8ae5-030fc2c3213b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:12:41 user nova-compute[71516]: DEBUG nova.network.neutron [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Refreshing network info cache for port 9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Updating instance_info_cache with network_info: [{"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Releasing lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:12:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] Instance destroyed successfully.
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'resources' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-306537180',display_name='tempest-AttachVolumeTestJSON-server-306537180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-306537180',id=16,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBCZV7mfgey8l84oWxyLPmpf/vUdIecbJfbZusGcLaLsUyVaAO/eUu8uumuNjaCqYf3u0A6YOPq2RC4XZqaH6cL8LKWE4mILFzbc1EBe4QFoOM0qAj4Mr6qKrIzOcb4DQ==',key_name='tempest-keypair-759307061',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f0ff3d48596a44f8ac8d9306becd8178',ramdisk_id='',reservation_id='r-75uy56ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-343820803',owner_user_name='tempest-AttachVolumeTestJSON-343820803-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1793cec543e8425899474614b2c10f5d',uuid=e4d31874-4273-48bc-8811-89832d18b893,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converting VIF {"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_vif [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac90e400-80, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:12:42 user nova-compute[71516]: INFO os_vif [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80')
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etIkblUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:12:42 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[20179311-45be-41bc-9f98-3a7c13f79dfa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:12:42 user nova-compute[71516]: No targets found.
Apr 11 23:12:42 user nova-compute[71516]: iSNS:
Apr 11 23:12:42 user nova-compute[71516]: No targets found.
Apr 11 23:12:42 user nova-compute[71516]: STATIC:
Apr 11 23:12:42 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5
Apr 11 23:12:42 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:42 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:42 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68
Apr 11 23:12:42 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:42 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:42 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee
Apr 11 23:12:42 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:42 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:42 user nova-compute[71516]: FIRMWARE:
Apr 11 23:12:42 user nova-compute[71516]: No targets found.
Apr 11 23:12:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:12:42 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:12:42 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:42 user nova-compute[71516]: INFO nova.compute.manager [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Terminating instance
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.compute.manager [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b322b1a-1437-4c27-86c0-f7244ff261f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40c6853-ef70-4fd3-aeb5-019ef7bde794]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:42 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:42 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:42 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:42 user nova-compute[71516]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5419ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68'): ({'sdg'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Removing single pathed devices sdg {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac67280-b758-42dc-b34d-470617556fd0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a322705f-168f-4110-9f50-f31a87136493]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flushing IO for device /dev/sdg {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bd1d46-8e81-42ef-adce-4ce644f679f4]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b0620e-4894-418b-a2b2-e63936bbd515]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] SCSI volumes sdg have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cb1192-4e99-4278-aa52-9795d08228ae]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2dd728-094f-4d5e-a257-ef4d0b067b2c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260]
Apr 11 23:12:42 user nova-compute[71516]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260] successful.
Apr 11 23:12:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9202d669-d373-477a-9f5d-e91112e4bddb]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] <== disconnect_volume: return (324ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Start _get_guest_xml network_info=[{"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etIkblUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'e4d31874-4273-48bc-8811-89832d18b893', 'attached_at': '', 'detached_at': '', 'volume_id': '75f7d204-26d3-4992-8036-0690d066ab68', 'serial': '75f7d204-26d3-4992-8036-0690d066ab68'}, 'disk_bus': 'virtio', 'attachment_id': 'f64a2948-7d58-4bc1-9cc3-83d1eb2721a3', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'numa_topology' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:42 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:12:42 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etIkblUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:12:42 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:12:42 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:12:42 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-2ce7fbc1-aaa2-4103-8fe3-1f2adf443dbf req-a4b323b9-ae75-4872-b286-035d1100a7ed service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Received event network-vif-unplugged-9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2ce7fbc1-aaa2-4103-8fe3-1f2adf443dbf req-a4b323b9-ae75-4872-b286-035d1100a7ed service nova] Acquiring lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2ce7fbc1-aaa2-4103-8fe3-1f2adf443dbf req-a4b323b9-ae75-4872-b286-035d1100a7ed service nova] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2ce7fbc1-aaa2-4103-8fe3-1f2adf443dbf req-a4b323b9-ae75-4872-b286-035d1100a7ed service nova] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-2ce7fbc1-aaa2-4103-8fe3-1f2adf443dbf req-a4b323b9-ae75-4872-b286-035d1100a7ed service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] No waiting events found dispatching network-vif-unplugged-9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-2ce7fbc1-aaa2-4103-8fe3-1f2adf443dbf req-a4b323b9-ae75-4872-b286-035d1100a7ed service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Received event network-vif-unplugged-9c2c207b-c711-42ef-9608-cbb701d5406f for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc16eee9-46be-4633-8dbc-40fc3f350cdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:12:42 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb82806d-8131-45ff-90cd-de5798f178b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68] added
Apr 11 23:12:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed26a29-f2b9-4aa3-b614-7726c6b99228]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.network.neutron [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Updated VIF entry in instance network info cache for port 9c2c207b-c711-42ef-9608-cbb701d5406f. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.network.neutron [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Updating instance_info_cache with network_info: [{"id": "9c2c207b-c711-42ef-9608-cbb701d5406f", "address": "fa:16:3e:74:c4:27", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c207b-c7", "ovs_interfaceid": "9c2c207b-c711-42ef-9608-cbb701d5406f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab946d9-b02d-47af-a0a6-2e8b37e92bc9]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] Releasing lock "refresh_cache-f2f6794f-cdcf-422e-8ae5-030fc2c3213b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etIkblUW {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etIkblUW" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[19104957-859b-4318-8a70-c57ecba44f1b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etIkblUW'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bf4504-27aa-472a-8e38-3b53bd69c851]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e3d033-3d1e-4608-b437-1e1c243c486b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:42 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:42 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Instance destroyed successfully.
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.objects.instance [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'resources' on Instance uuid f2f6794f-cdcf-422e-8ae5-030fc2c3213b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1566798189',display_name='tempest-AttachVolumeNegativeTest-server-1566798189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1566798189',id=20,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBMEewzXEFy6CSMxptTsXBa5J41k9pW5kYlrexIdLtOBRh01epIt7LV7EDJlwObFzREbUoeDYDcdXxxRAjnOopOEfu8u05/8uauEotW0z7ypKiOFDNzAI9D4I71bSqQGg==',key_name='tempest-keypair-871178907',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:10:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f29d28c472c4f65b8437ce443d208c7',ramdisk_id='',reservation_id='r-703ls7p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2123485934',owner_user_name='tempest-AttachVolumeNegativeTest-2123485934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:10:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da1389f3e27f49f394598636d041a9c9',uuid=f2f6794f-cdcf-422e-8ae5-030fc2c3213b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c2c207b-c711-42ef-9608-cbb701d5406f", "address": "fa:16:3e:74:c4:27", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c207b-c7", "ovs_interfaceid": "9c2c207b-c711-42ef-9608-cbb701d5406f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converting VIF {"id": "9c2c207b-c711-42ef-9608-cbb701d5406f", "address": "fa:16:3e:74:c4:27", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c207b-c7", "ovs_interfaceid": "9c2c207b-c711-42ef-9608-cbb701d5406f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=9c2c207b-c711-42ef-9608-cbb701d5406f,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c207b-c7') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_vif [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=9c2c207b-c711-42ef-9608-cbb701d5406f,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c207b-c7') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffebd50f-76d3-487b-bf1e-d93b7a3ef89b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c2c207b-c7, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260]
Apr 11 23:12:42 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260] successful.
Apr 11 23:12:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:12:42 user nova-compute[71516]: INFO os_vif [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=9c2c207b-c711-42ef-9608-cbb701d5406f,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c207b-c7')
Apr 11 23:12:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Deleting instance files /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b_del
Apr 11 23:12:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Deletion of /opt/stack/data/nova/instances/f2f6794f-cdcf-422e-8ae5-030fc2c3213b_del complete
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e32623-5588-4ac6-ab64-85bec5847c3a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea47d181-71db-420e-8ead-3db9703690c5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:42 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:42 user nova-compute[71516]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:42 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:42 user nova-compute[71516]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:12:42 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:12:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1e6151-0ca8-47f2-b871-165f30936f3c]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:43 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:12:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etIkblUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:12:43 user nova-compute[71516]: INFO nova.compute.manager [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Took 0.76 seconds to destroy the instance on the hypervisor.
Apr 11 23:12:43 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:12:43 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:12:43 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:12:43 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:12:43 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Took 0.86 seconds to deallocate network for instance.
Apr 11 23:12:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26666663137646533', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666663137646533', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-306537180',display_name='tempest-AttachVolumeTestJSON-server-306537180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-306537180',id=16,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBCZV7mfgey8l84oWxyLPmpf/vUdIecbJfbZusGcLaLsUyVaAO/eUu8uumuNjaCqYf3u0A6YOPq2RC4XZqaH6cL8LKWE4mILFzbc1EBe4QFoOM0qAj4Mr6qKrIzOcb4DQ==',key_name='tempest-keypair-759307061',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f0ff3d48596a44f8ac8d9306becd8178',ramdisk_id='',reservation_id='r-75uy56ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-343820803',owner_user_name='tempest-AttachVolumeTestJSON-343820803-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1793cec543e8425899474614b2c10f5d',uuid=e4d31874-4273-48bc-8811-89832d18b893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converting VIF {"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'pci_devices' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:12:44 user nova-compute[71516]:   <uuid>e4d31874-4273-48bc-8811-89832d18b893</uuid>
Apr 11 23:12:44 user nova-compute[71516]:   <name>instance-00000010</name>
Apr 11 23:12:44 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:12:44 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:12:44 user nova-compute[71516]:   <metadata>
Apr 11 23:12:44 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:12:44 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:12:44 user nova-compute[71516]:       <nova:name>tempest-AttachVolumeTestJSON-server-306537180</nova:name>
Apr 11 23:12:44 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:12:42</nova:creationTime>
Apr 11 23:12:44 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:12:44 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:12:44 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:12:44 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:12:44 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:12:44 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:12:44 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:12:44 user nova-compute[71516]:       <nova:owner>
Apr 11 23:12:44 user nova-compute[71516]:         <nova:user uuid="1793cec543e8425899474614b2c10f5d">tempest-AttachVolumeTestJSON-343820803-project-member</nova:user>
Apr 11 23:12:44 user nova-compute[71516]:         <nova:project uuid="f0ff3d48596a44f8ac8d9306becd8178">tempest-AttachVolumeTestJSON-343820803</nova:project>
Apr 11 23:12:44 user nova-compute[71516]:       </nova:owner>
Apr 11 23:12:44 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:12:44 user nova-compute[71516]:       <nova:ports>
Apr 11 23:12:44 user nova-compute[71516]:         <nova:port uuid="ac90e400-803b-41b5-b183-f93bfbf297b6">
Apr 11 23:12:44 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 23:12:44 user nova-compute[71516]:         </nova:port>
Apr 11 23:12:44 user nova-compute[71516]:       </nova:ports>
Apr 11 23:12:44 user nova-compute[71516]:     </nova:instance>
Apr 11 23:12:44 user nova-compute[71516]:   </metadata>
Apr 11 23:12:44 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:12:44 user nova-compute[71516]:     <system>
Apr 11 23:12:44 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:12:44 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:12:44 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:12:44 user nova-compute[71516]:       <entry name="serial">e4d31874-4273-48bc-8811-89832d18b893</entry>
Apr 11 23:12:44 user nova-compute[71516]:       <entry name="uuid">e4d31874-4273-48bc-8811-89832d18b893</entry>
Apr 11 23:12:44 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:12:44 user nova-compute[71516]:     </system>
Apr 11 23:12:44 user nova-compute[71516]:   </sysinfo>
Apr 11 23:12:44 user nova-compute[71516]:   <os>
Apr 11 23:12:44 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:12:44 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:12:44 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:12:44 user nova-compute[71516]:   </os>
Apr 11 23:12:44 user nova-compute[71516]:   <features>
Apr 11 23:12:44 user nova-compute[71516]:     <acpi/>
Apr 11 23:12:44 user nova-compute[71516]:     <apic/>
Apr 11 23:12:44 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:12:44 user nova-compute[71516]:   </features>
Apr 11 23:12:44 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:12:44 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:12:44 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:12:44 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:12:44 user nova-compute[71516]:   </clock>
Apr 11 23:12:44 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:12:44 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:12:44 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:12:44 user nova-compute[71516]:   </cpu>
Apr 11 23:12:44 user nova-compute[71516]:   <devices>
Apr 11 23:12:44 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:12:44 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:12:44 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk"/>
Apr 11 23:12:44 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:12:44 user nova-compute[71516]:     </disk>
Apr 11 23:12:44 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:12:44 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:12:44 user nova-compute[71516]:       <source dev="/dev/sdc"/>
Apr 11 23:12:44 user nova-compute[71516]:       <target dev="vdb" bus="virtio"/>
Apr 11 23:12:44 user nova-compute[71516]:       <serial>75f7d204-26d3-4992-8036-0690d066ab68</serial>
Apr 11 23:12:44 user nova-compute[71516]:     </disk>
Apr 11 23:12:44 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:12:44 user nova-compute[71516]:       <mac address="fa:16:3e:f7:1e:78"/>
Apr 11 23:12:44 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:12:44 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:12:44 user nova-compute[71516]:       <target dev="tapac90e400-80"/>
Apr 11 23:12:44 user nova-compute[71516]:     </interface>
Apr 11 23:12:44 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:12:44 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/console.log" append="off"/>
Apr 11 23:12:44 user nova-compute[71516]:     </serial>
Apr 11 23:12:44 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:12:44 user nova-compute[71516]:     <video>
Apr 11 23:12:44 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:12:44 user nova-compute[71516]:     </video>
Apr 11 23:12:44 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:12:44 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:12:44 user nova-compute[71516]:     </rng>
Apr 11 23:12:44 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:12:44 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:12:44 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:12:44 user nova-compute[71516]:     </memballoon>
Apr 11 23:12:44 user nova-compute[71516]:   </devices>
Apr 11 23:12:44 user nova-compute[71516]: </domain>
Apr 11 23:12:44 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:44 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Deleted allocations for instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b
Apr 11 23:12:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'trusted_certs' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.181s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Cannot resize image /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'migration_context' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-306537180',display_name='tempest-AttachVolumeTestJSON-server-306537180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-306537180',id=16,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBCZV7mfgey8l84oWxyLPmpf/vUdIecbJfbZusGcLaLsUyVaAO/eUu8uumuNjaCqYf3u0A6YOPq2RC4XZqaH6cL8LKWE4mILFzbc1EBe4QFoOM0qAj4Mr6qKrIzOcb4DQ==',key_name='tempest-keypair-759307061',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f0ff3d48596a44f8ac8d9306becd8178',ramdisk_id='',reservation_id='r-75uy56ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-343820803',owner_user_name='tempest-AttachVolumeTestJSON-343820803-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1793cec543e8425899474614b2c10f5d',uuid=e4d31874-4273-48bc-8811-89832d18b893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converting VIF {"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG os_vif [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac90e400-80, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac90e400-80, col_values=(('external_ids', {'iface-id': 'ac90e400-803b-41b5-b183-f93bfbf297b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:1e:78', 'vm-uuid': 'e4d31874-4273-48bc-8811-89832d18b893'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Received event network-vif-plugged-9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] Acquiring lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] Lock "f2f6794f-cdcf-422e-8ae5-030fc2c3213b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] No waiting events found dispatching network-vif-plugged-9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:44 user nova-compute[71516]: WARNING nova.compute.manager [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Received unexpected event network-vif-plugged-9c2c207b-c711-42ef-9608-cbb701d5406f for instance with vm_state deleted and task_state None.
Apr 11 23:12:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Received event network-vif-deleted-9c2c207b-c711-42ef-9608-cbb701d5406f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:44 user nova-compute[71516]: INFO os_vif [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80')
Apr 11 23:12:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-bffd72fe-0820-4e49-9fd1-828816e2adf7 req-4444cd1c-820b-48e7-94ff-be801d6e8415 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bffd72fe-0820-4e49-9fd1-828816e2adf7 req-4444cd1c-820b-48e7-94ff-be801d6e8415 service nova] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bffd72fe-0820-4e49-9fd1-828816e2adf7 req-4444cd1c-820b-48e7-94ff-be801d6e8415 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bffd72fe-0820-4e49-9fd1-828816e2adf7 req-4444cd1c-820b-48e7-94ff-be801d6e8415 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-bffd72fe-0820-4e49-9fd1-828816e2adf7 req-4444cd1c-820b-48e7-94ff-be801d6e8415 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] No waiting events found dispatching network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:46 user nova-compute[71516]: WARNING nova.compute.manager [req-bffd72fe-0820-4e49-9fd1-828816e2adf7 req-4444cd1c-820b-48e7-94ff-be801d6e8415 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received unexpected event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 for instance with vm_state stopped and task_state powering-on.
Apr 11 23:12:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:48 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254768.1844778, e4d31874-4273-48bc-8811-89832d18b893 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:12:48 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] VM Resumed (Lifecycle Event)
Apr 11 23:12:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:12:48 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] Instance rebooted successfully.
Apr 11 23:12:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:12:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:12:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:12:48 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 23:12:48 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254768.1885512, e4d31874-4273-48bc-8811-89832d18b893 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:12:48 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] VM Started (Lifecycle Event)
Apr 11 23:12:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:12:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:12:48 user nova-compute[71516]: DEBUG nova.compute.manager [req-834f5d7f-75ba-4f4a-a59e-8b943356f41e req-3f757ec3-98ea-4b5b-bc75-9e496128fc50 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-834f5d7f-75ba-4f4a-a59e-8b943356f41e req-3f757ec3-98ea-4b5b-bc75-9e496128fc50 service nova] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-834f5d7f-75ba-4f4a-a59e-8b943356f41e req-3f757ec3-98ea-4b5b-bc75-9e496128fc50 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-834f5d7f-75ba-4f4a-a59e-8b943356f41e req-3f757ec3-98ea-4b5b-bc75-9e496128fc50 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:48 user nova-compute[71516]: DEBUG nova.compute.manager [req-834f5d7f-75ba-4f4a-a59e-8b943356f41e req-3f757ec3-98ea-4b5b-bc75-9e496128fc50 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] No waiting events found dispatching network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:48 user nova-compute[71516]: WARNING nova.compute.manager [req-834f5d7f-75ba-4f4a-a59e-8b943356f41e req-3f757ec3-98ea-4b5b-bc75-9e496128fc50 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received unexpected event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 for instance with vm_state active and task_state None.
Apr 11 23:12:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:52 user nova-compute[71516]: INFO nova.compute.manager [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Terminating instance
Apr 11 23:12:52 user nova-compute[71516]: DEBUG nova.compute.manager [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:12:52 user nova-compute[71516]: INFO nova.compute.claims [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Claim successful on node user
Apr 11 23:12:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-d3046a2b-5125-4242-a863-7aa902242437 req-aadd97ab-75ef-4a9b-9cf8-6520a40cd560 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Received event network-vif-unplugged-138c5b33-78b0-4ca8-a952-7be3e230441b {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d3046a2b-5125-4242-a863-7aa902242437 req-aadd97ab-75ef-4a9b-9cf8-6520a40cd560 service nova] Acquiring lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d3046a2b-5125-4242-a863-7aa902242437 req-aadd97ab-75ef-4a9b-9cf8-6520a40cd560 service nova] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d3046a2b-5125-4242-a863-7aa902242437 req-aadd97ab-75ef-4a9b-9cf8-6520a40cd560 service nova] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-d3046a2b-5125-4242-a863-7aa902242437 req-aadd97ab-75ef-4a9b-9cf8-6520a40cd560 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] No waiting events found dispatching network-vif-unplugged-138c5b33-78b0-4ca8-a952-7be3e230441b {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-d3046a2b-5125-4242-a863-7aa902242437 req-aadd97ab-75ef-4a9b-9cf8-6520a40cd560 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Received event network-vif-unplugged-138c5b33-78b0-4ca8-a952-7be3e230441b for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:12:52 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:12:53 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:12:53 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Instance destroyed successfully.
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.objects.instance [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lazy-loading 'resources' on Instance uuid 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-205162088',display_name='tempest-TestVolumeBootPattern-volume-backed-server-205162088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-205162088',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:08:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-4vk1ldh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:08:27Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=2bd67ca7-90b7-4881-9fb1-a1a23cc424fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "138c5b33-78b0-4ca8-a952-7be3e230441b", "address": "fa:16:3e:b4:8e:33", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138c5b33-78", "ovs_interfaceid": "138c5b33-78b0-4ca8-a952-7be3e230441b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "138c5b33-78b0-4ca8-a952-7be3e230441b", "address": "fa:16:3e:b4:8e:33", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap138c5b33-78", "ovs_interfaceid": "138c5b33-78b0-4ca8-a952-7be3e230441b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:8e:33,bridge_name='br-int',has_traffic_filtering=True,id=138c5b33-78b0-4ca8-a952-7be3e230441b,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138c5b33-78') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_vif [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:8e:33,bridge_name='br-int',has_traffic_filtering=True,id=138c5b33-78b0-4ca8-a952-7be3e230441b,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138c5b33-78') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap138c5b33-78, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:12:53 user nova-compute[71516]: INFO os_vif [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:8e:33,bridge_name='br-int',has_traffic_filtering=True,id=138c5b33-78b0-4ca8-a952-7be3e230441b,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138c5b33-78')
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECkHzdLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:12:53 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[28653cf0-97e1-42e2-9765-6b7821008222]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:12:53 user nova-compute[71516]: No targets found.
Apr 11 23:12:53 user nova-compute[71516]: iSNS:
Apr 11 23:12:53 user nova-compute[71516]: No targets found.
Apr 11 23:12:53 user nova-compute[71516]: STATIC:
Apr 11 23:12:53 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5
Apr 11 23:12:53 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:53 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:53 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68
Apr 11 23:12:53 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:53 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:53 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee
Apr 11 23:12:53 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:12:53 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:12:53 user nova-compute[71516]: FIRMWARE:
Apr 11 23:12:53 user nova-compute[71516]: No targets found.
Apr 11 23:12:53 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:12:53 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:12:53 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[01930c46-0a2b-41b5-8556-4af3b05c65df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.policy [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b9ffaa1f08b42ca9af5ce17a283f51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af76ed8ad9f4a429e346b6f8eedf895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b090ef-aeea-458e-99fd-d9952f57cff0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:53 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:53 user nova-compute[71516]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:53 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 (non-flash)
Apr 11 23:12:53 user nova-compute[71516]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:12:53 user nova-compute[71516]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:12:53 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c716290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5'): ({'sdb'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Removing single pathed devices sdb {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:12:53 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Creating image(s)
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "/opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "/opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cd49e3-45b7-4f86-bea0-c4c90ec5cb8a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35a745e-0608-48da-a2cb-7613e262bb22]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flushing IO for device /dev/sdb {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f6ee6c-5bdc-4cbd-9f79-ecf2d8ea2d9a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.156s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[012bbc60-3c63-4ae8-8f67-a19c244ddffb]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34f80cf-777b-447b-9089-a7dc3bc40a6e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb132e13-6917-4e09-b934-19ed86c1fab4]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5, portal: 172.16.0.220,3260]
Apr 11 23:12:53 user nova-compute[71516]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5, portal: 172.16.0.220,3260] successful.
Apr 11 23:12:53 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.145s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f79365f-d1d4-4c01-94f3-205e20bec9d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf76732-17f4-4121-8bb9-b4ef189abd9c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== disconnect_volume: return (449ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:12:53 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Deleting instance files /opt/stack/data/nova/instances/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe_del
Apr 11 23:12:53 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Deletion of /opt/stack/data/nova/instances/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe_del complete
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk 1073741824" returned: 0 in 0.055s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: INFO nova.compute.manager [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Took 1.32 seconds to destroy the instance on the hypervisor.
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Cannot resize image /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.objects.instance [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lazy-loading 'migration_context' on Instance uuid f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:12:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Ensure instance console log exists: /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:12:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:54 user nova-compute[71516]: DEBUG nova.network.neutron [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Successfully created port: a88122ee-01e7-411d-9ce2-2e8265b5aba5 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:12:54 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:12:54 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Took 1.05 seconds to deallocate network for instance.
Apr 11 23:12:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-43e622ae-6a10-4d50-baca-9342f9d05c0b req-26c9bd3f-63ec-4822-aab5-31c38a11472b service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Received event network-vif-deleted-138c5b33-78b0-4ca8-a952-7be3e230441b {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-ee1e9708-3890-4008-83c6-5e842370d1d3 req-594e805a-3c56-4157-ade8-1d89e8bb5cf2 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Received event network-vif-plugged-138c5b33-78b0-4ca8-a952-7be3e230441b {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ee1e9708-3890-4008-83c6-5e842370d1d3 req-594e805a-3c56-4157-ade8-1d89e8bb5cf2 service nova] Acquiring lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ee1e9708-3890-4008-83c6-5e842370d1d3 req-594e805a-3c56-4157-ade8-1d89e8bb5cf2 service nova] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ee1e9708-3890-4008-83c6-5e842370d1d3 req-594e805a-3c56-4157-ade8-1d89e8bb5cf2 service nova] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-ee1e9708-3890-4008-83c6-5e842370d1d3 req-594e805a-3c56-4157-ade8-1d89e8bb5cf2 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] No waiting events found dispatching network-vif-plugged-138c5b33-78b0-4ca8-a952-7be3e230441b {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:55 user nova-compute[71516]: WARNING nova.compute.manager [req-ee1e9708-3890-4008-83c6-5e842370d1d3 req-594e805a-3c56-4157-ade8-1d89e8bb5cf2 service nova] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Received unexpected event network-vif-plugged-138c5b33-78b0-4ca8-a952-7be3e230441b for instance with vm_state active and task_state deleting.
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.network.neutron [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Successfully updated port: a88122ee-01e7-411d-9ce2-2e8265b5aba5 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "refresh_cache-f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquired lock "refresh_cache-f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.network.neutron [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.network.neutron [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:12:55 user nova-compute[71516]: INFO nova.compute.manager [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Took 0.94 seconds to detach 1 volumes for instance.
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Deleting volume: 1f79365f-d1d4-4c01-94f3-205e20bec9d5 {{(pid=71516) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.network.neutron [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Updating instance_info_cache with network_info: [{"id": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "address": "fa:16:3e:de:36:ca", "network": {"id": "fc38e5dd-2ad6-4241-ae95-66147fb8e61e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc4c5175ee99459396db72418ed47d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88122ee-01", "ovs_interfaceid": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Releasing lock "refresh_cache-f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Instance network_info: |[{"id": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "address": "fa:16:3e:de:36:ca", "network": {"id": "fc38e5dd-2ad6-4241-ae95-66147fb8e61e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc4c5175ee99459396db72418ed47d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88122ee-01", "ovs_interfaceid": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Start _get_guest_xml network_info=[{"id": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "address": "fa:16:3e:de:36:ca", "network": {"id": "fc38e5dd-2ad6-4241-ae95-66147fb8e61e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc4c5175ee99459396db72418ed47d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88122ee-01", "ovs_interfaceid": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:12:55 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:12:55 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:12:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1014668258',display_name='tempest-VolumesNegativeTest-instance-1014668258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1014668258',id=22,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8af76ed8ad9f4a429e346b6f8eedf895',ramdisk_id='',reservation_id='r-cxur1pii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2128115870',owner_user_name='tempest-VolumesNegativeTest-2128115870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:12:53Z,user_data=None,user_id='6b9ffaa1f08b42ca9af5ce17a283f51b',uuid=f1767c12-a304-4d8c-a8bf-06e2bfa3aa59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "address": "fa:16:3e:de:36:ca", "network": {"id": "fc38e5dd-2ad6-4241-ae95-66147fb8e61e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc4c5175ee99459396db72418ed47d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88122ee-01", "ovs_interfaceid": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Converting VIF {"id": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "address": "fa:16:3e:de:36:ca", "network": {"id": "fc38e5dd-2ad6-4241-ae95-66147fb8e61e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc4c5175ee99459396db72418ed47d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88122ee-01", "ovs_interfaceid": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=a88122ee-01e7-411d-9ce2-2e8265b5aba5,network=Network(fc38e5dd-2ad6-4241-ae95-66147fb8e61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88122ee-01') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.objects.instance [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lazy-loading 'pci_devices' on Instance uuid f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:12:56 user nova-compute[71516]:   <uuid>f1767c12-a304-4d8c-a8bf-06e2bfa3aa59</uuid>
Apr 11 23:12:56 user nova-compute[71516]:   <name>instance-00000016</name>
Apr 11 23:12:56 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:12:56 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:12:56 user nova-compute[71516]:   <metadata>
Apr 11 23:12:56 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:12:56 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:12:56 user nova-compute[71516]:       <nova:name>tempest-VolumesNegativeTest-instance-1014668258</nova:name>
Apr 11 23:12:56 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:12:55</nova:creationTime>
Apr 11 23:12:56 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:12:56 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:12:56 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:12:56 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:12:56 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:12:56 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:12:56 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:12:56 user nova-compute[71516]:       <nova:owner>
Apr 11 23:12:56 user nova-compute[71516]:         <nova:user uuid="6b9ffaa1f08b42ca9af5ce17a283f51b">tempest-VolumesNegativeTest-2128115870-project-member</nova:user>
Apr 11 23:12:56 user nova-compute[71516]:         <nova:project uuid="8af76ed8ad9f4a429e346b6f8eedf895">tempest-VolumesNegativeTest-2128115870</nova:project>
Apr 11 23:12:56 user nova-compute[71516]:       </nova:owner>
Apr 11 23:12:56 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:12:56 user nova-compute[71516]:       <nova:ports>
Apr 11 23:12:56 user nova-compute[71516]:         <nova:port uuid="a88122ee-01e7-411d-9ce2-2e8265b5aba5">
Apr 11 23:12:56 user nova-compute[71516]:           <nova:ip type="fixed" address="192.168.233.219" ipVersion="4"/>
Apr 11 23:12:56 user nova-compute[71516]:         </nova:port>
Apr 11 23:12:56 user nova-compute[71516]:       </nova:ports>
Apr 11 23:12:56 user nova-compute[71516]:     </nova:instance>
Apr 11 23:12:56 user nova-compute[71516]:   </metadata>
Apr 11 23:12:56 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:12:56 user nova-compute[71516]:     <system>
Apr 11 23:12:56 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:12:56 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:12:56 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:12:56 user nova-compute[71516]:       <entry name="serial">f1767c12-a304-4d8c-a8bf-06e2bfa3aa59</entry>
Apr 11 23:12:56 user nova-compute[71516]:       <entry name="uuid">f1767c12-a304-4d8c-a8bf-06e2bfa3aa59</entry>
Apr 11 23:12:56 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:12:56 user nova-compute[71516]:     </system>
Apr 11 23:12:56 user nova-compute[71516]:   </sysinfo>
Apr 11 23:12:56 user nova-compute[71516]:   <os>
Apr 11 23:12:56 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:12:56 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:12:56 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:12:56 user nova-compute[71516]:   </os>
Apr 11 23:12:56 user nova-compute[71516]:   <features>
Apr 11 23:12:56 user nova-compute[71516]:     <acpi/>
Apr 11 23:12:56 user nova-compute[71516]:     <apic/>
Apr 11 23:12:56 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:12:56 user nova-compute[71516]:   </features>
Apr 11 23:12:56 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:12:56 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:12:56 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:12:56 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:12:56 user nova-compute[71516]:   </clock>
Apr 11 23:12:56 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:12:56 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:12:56 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:12:56 user nova-compute[71516]:   </cpu>
Apr 11 23:12:56 user nova-compute[71516]:   <devices>
Apr 11 23:12:56 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:12:56 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:12:56 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk"/>
Apr 11 23:12:56 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:12:56 user nova-compute[71516]:     </disk>
Apr 11 23:12:56 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:12:56 user nova-compute[71516]:       <mac address="fa:16:3e:de:36:ca"/>
Apr 11 23:12:56 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:12:56 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:12:56 user nova-compute[71516]:       <target dev="tapa88122ee-01"/>
Apr 11 23:12:56 user nova-compute[71516]:     </interface>
Apr 11 23:12:56 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:12:56 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/console.log" append="off"/>
Apr 11 23:12:56 user nova-compute[71516]:     </serial>
Apr 11 23:12:56 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:12:56 user nova-compute[71516]:     <video>
Apr 11 23:12:56 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:12:56 user nova-compute[71516]:     </video>
Apr 11 23:12:56 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:12:56 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:12:56 user nova-compute[71516]:     </rng>
Apr 11 23:12:56 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:12:56 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:12:56 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:12:56 user nova-compute[71516]:     </memballoon>
Apr 11 23:12:56 user nova-compute[71516]:   </devices>
Apr 11 23:12:56 user nova-compute[71516]: </domain>
Apr 11 23:12:56 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1014668258',display_name='tempest-VolumesNegativeTest-instance-1014668258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1014668258',id=22,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8af76ed8ad9f4a429e346b6f8eedf895',ramdisk_id='',reservation_id='r-cxur1pii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2128115870',owner_user_name='tempest-VolumesNegativeTest-2128115870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:12:53Z,user_data=None,user_id='6b9ffaa1f08b42ca9af5ce17a283f51b',uuid=f1767c12-a304-4d8c-a8bf-06e2bfa3aa59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "address": "fa:16:3e:de:36:ca", "network": {"id": "fc38e5dd-2ad6-4241-ae95-66147fb8e61e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc4c5175ee99459396db72418ed47d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88122ee-01", "ovs_interfaceid": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Converting VIF {"id": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "address": "fa:16:3e:de:36:ca", "network": {"id": "fc38e5dd-2ad6-4241-ae95-66147fb8e61e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc4c5175ee99459396db72418ed47d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88122ee-01", "ovs_interfaceid": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=a88122ee-01e7-411d-9ce2-2e8265b5aba5,network=Network(fc38e5dd-2ad6-4241-ae95-66147fb8e61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88122ee-01') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG os_vif [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=a88122ee-01e7-411d-9ce2-2e8265b5aba5,network=Network(fc38e5dd-2ad6-4241-ae95-66147fb8e61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88122ee-01') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa88122ee-01, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa88122ee-01, col_values=(('external_ids', {'iface-id': 'a88122ee-01e7-411d-9ce2-2e8265b5aba5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:36:ca', 'vm-uuid': 'f1767c12-a304-4d8c-a8bf-06e2bfa3aa59'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:56 user nova-compute[71516]: INFO os_vif [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=a88122ee-01e7-411d-9ce2-2e8265b5aba5,network=Network(fc38e5dd-2ad6-4241-ae95-66147fb8e61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88122ee-01')
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] No VIF found with MAC fa:16:3e:de:36:ca, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:56 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Deleted allocations for instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe
Apr 11 23:12:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.936s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Received event network-changed-a88122ee-01e7-411d-9ce2-2e8265b5aba5 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Refreshing instance network info cache due to event network-changed-a88122ee-01e7-411d-9ce2-2e8265b5aba5. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] Acquiring lock "refresh_cache-f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] Acquired lock "refresh_cache-f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:12:56 user nova-compute[71516]: DEBUG nova.network.neutron [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Refreshing network info cache for port a88122ee-01e7-411d-9ce2-2e8265b5aba5 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:12:57 user nova-compute[71516]: DEBUG nova.network.neutron [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Updated VIF entry in instance network info cache for port a88122ee-01e7-411d-9ce2-2e8265b5aba5. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:12:57 user nova-compute[71516]: DEBUG nova.network.neutron [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Updating instance_info_cache with network_info: [{"id": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "address": "fa:16:3e:de:36:ca", "network": {"id": "fc38e5dd-2ad6-4241-ae95-66147fb8e61e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc4c5175ee99459396db72418ed47d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88122ee-01", "ovs_interfaceid": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:12:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] Releasing lock "refresh_cache-f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:12:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:57 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254762.9167035, f2f6794f-cdcf-422e-8ae5-030fc2c3213b => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:12:57 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] VM Stopped (Lifecycle Event)
Apr 11 23:12:57 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b5ddb333-a341-45aa-b3e6-9bd3fcd33479 None None] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:12:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:12:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Received event network-vif-plugged-a88122ee-01e7-411d-9ce2-2e8265b5aba5 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] Acquiring lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] No waiting events found dispatching network-vif-plugged-a88122ee-01e7-411d-9ce2-2e8265b5aba5 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:58 user nova-compute[71516]: WARNING nova.compute.manager [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Received unexpected event network-vif-plugged-a88122ee-01e7-411d-9ce2-2e8265b5aba5 for instance with vm_state building and task_state spawning.
Apr 11 23:12:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Received event network-vif-plugged-a88122ee-01e7-411d-9ce2-2e8265b5aba5 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:12:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] Acquiring lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:12:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:12:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:12:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] No waiting events found dispatching network-vif-plugged-a88122ee-01e7-411d-9ce2-2e8265b5aba5 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:12:58 user nova-compute[71516]: WARNING nova.compute.manager [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Received unexpected event network-vif-plugged-a88122ee-01e7-411d-9ce2-2e8265b5aba5 for instance with vm_state building and task_state spawning.
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254779.5970936, f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:12:59 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] VM Resumed (Lifecycle Event)
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:12:59 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Instance spawned successfully.
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:12:59 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254779.598853, f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:12:59 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] VM Started (Lifecycle Event)
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:12:59 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:12:59 user nova-compute[71516]: INFO nova.compute.manager [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Took 6.40 seconds to spawn the instance on the hypervisor.
Apr 11 23:12:59 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:12:59 user nova-compute[71516]: INFO nova.compute.manager [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Took 7.19 seconds to build instance.
Apr 11 23:12:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.294s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:13:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:02 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:13:02 user nova-compute[71516]: INFO nova.compute.claims [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Claim successful on node user
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:13:03 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.policy [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "61204bbb-04fb-4545-ade1-5665c733c5bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:13:03 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Creating image(s)
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "/opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "/opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:13:03 user nova-compute[71516]: INFO nova.compute.claims [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Claim successful on node user
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.169s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.157s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk 1073741824" returned: 0 in 0.050s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.151s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Successfully created port: af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.network.neutron [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:13:04 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Cannot resize image /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.objects.instance [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'migration_context' on Instance uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Ensure instance console log exists: /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:13:04 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Creating image(s)
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "/opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "/opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "/opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.policy [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.165s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk 1073741824" returned: 0 in 0.051s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.153s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Cannot resize image /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.objects.instance [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'migration_context' on Instance uuid 61204bbb-04fb-4545-ade1-5665c733c5bd {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Ensure instance console log exists: /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.network.neutron [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Successfully updated port: af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquired lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.network.neutron [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-changed-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Refreshing instance network info cache due to event network-changed-af81e577-93ac-47a7-8666-377d53fad5c2. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] Acquiring lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.network.neutron [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Successfully created port: 6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.network.neutron [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.network.neutron [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Updating instance_info_cache with network_info: [{"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Releasing lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.compute.manager [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Instance network_info: |[{"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] Acquired lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.network.neutron [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Refreshing network info cache for port af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Start _get_guest_xml network_info=[{"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:13:05 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:13:05 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1692522881',display_name='tempest-ServerRescueNegativeTestJSON-server-1692522881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1692522881',id=23,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31c373270f804948a04c8125848fa181',ramdisk_id='',reservation_id='r-wpvajt0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-242021724',owner_user_name='tempest-ServerRescueNegativeTestJSON-242021724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:13:03Z,user_data=None,user_id='8d63779eda794ef0b2413ac1483f88b8',uuid=dd8aa618-99bb-49d7-b547-e5db4470f4c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converting VIF {"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:11:46,bridge_name='br-int',has_traffic_filtering=True,id=af81e577-93ac-47a7-8666-377d53fad5c2,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81e577-93') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.objects.instance [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'pci_devices' on Instance uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:13:05 user nova-compute[71516]:   <uuid>dd8aa618-99bb-49d7-b547-e5db4470f4c6</uuid>
Apr 11 23:13:05 user nova-compute[71516]:   <name>instance-00000017</name>
Apr 11 23:13:05 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:13:05 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:13:05 user nova-compute[71516]:   <metadata>
Apr 11 23:13:05 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:13:05 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:13:05 user nova-compute[71516]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1692522881</nova:name>
Apr 11 23:13:05 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:13:05</nova:creationTime>
Apr 11 23:13:05 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:13:05 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:13:05 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:13:05 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:13:05 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:13:05 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:13:05 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:13:05 user nova-compute[71516]:       <nova:owner>
Apr 11 23:13:05 user nova-compute[71516]:         <nova:user uuid="8d63779eda794ef0b2413ac1483f88b8">tempest-ServerRescueNegativeTestJSON-242021724-project-member</nova:user>
Apr 11 23:13:05 user nova-compute[71516]:         <nova:project uuid="31c373270f804948a04c8125848fa181">tempest-ServerRescueNegativeTestJSON-242021724</nova:project>
Apr 11 23:13:05 user nova-compute[71516]:       </nova:owner>
Apr 11 23:13:05 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:13:05 user nova-compute[71516]:       <nova:ports>
Apr 11 23:13:05 user nova-compute[71516]:         <nova:port uuid="af81e577-93ac-47a7-8666-377d53fad5c2">
Apr 11 23:13:05 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 23:13:05 user nova-compute[71516]:         </nova:port>
Apr 11 23:13:05 user nova-compute[71516]:       </nova:ports>
Apr 11 23:13:05 user nova-compute[71516]:     </nova:instance>
Apr 11 23:13:05 user nova-compute[71516]:   </metadata>
Apr 11 23:13:05 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:13:05 user nova-compute[71516]:     <system>
Apr 11 23:13:05 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:13:05 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:13:05 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:13:05 user nova-compute[71516]:       <entry name="serial">dd8aa618-99bb-49d7-b547-e5db4470f4c6</entry>
Apr 11 23:13:05 user nova-compute[71516]:       <entry name="uuid">dd8aa618-99bb-49d7-b547-e5db4470f4c6</entry>
Apr 11 23:13:05 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:13:05 user nova-compute[71516]:     </system>
Apr 11 23:13:05 user nova-compute[71516]:   </sysinfo>
Apr 11 23:13:05 user nova-compute[71516]:   <os>
Apr 11 23:13:05 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:13:05 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:13:05 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:13:05 user nova-compute[71516]:   </os>
Apr 11 23:13:05 user nova-compute[71516]:   <features>
Apr 11 23:13:05 user nova-compute[71516]:     <acpi/>
Apr 11 23:13:05 user nova-compute[71516]:     <apic/>
Apr 11 23:13:05 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:13:05 user nova-compute[71516]:   </features>
Apr 11 23:13:05 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:13:05 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:13:05 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:13:05 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:13:05 user nova-compute[71516]:   </clock>
Apr 11 23:13:05 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:13:05 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:13:05 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:13:05 user nova-compute[71516]:   </cpu>
Apr 11 23:13:05 user nova-compute[71516]:   <devices>
Apr 11 23:13:05 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:13:05 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:13:05 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk"/>
Apr 11 23:13:05 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:13:05 user nova-compute[71516]:     </disk>
Apr 11 23:13:05 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:13:05 user nova-compute[71516]:       <mac address="fa:16:3e:24:11:46"/>
Apr 11 23:13:05 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:13:05 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:13:05 user nova-compute[71516]:       <target dev="tapaf81e577-93"/>
Apr 11 23:13:05 user nova-compute[71516]:     </interface>
Apr 11 23:13:05 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:13:05 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/console.log" append="off"/>
Apr 11 23:13:05 user nova-compute[71516]:     </serial>
Apr 11 23:13:05 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:13:05 user nova-compute[71516]:     <video>
Apr 11 23:13:05 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:13:05 user nova-compute[71516]:     </video>
Apr 11 23:13:05 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:13:05 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:13:05 user nova-compute[71516]:     </rng>
Apr 11 23:13:05 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:13:05 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:13:05 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:13:05 user nova-compute[71516]:     </memballoon>
Apr 11 23:13:05 user nova-compute[71516]:   </devices>
Apr 11 23:13:05 user nova-compute[71516]: </domain>
Apr 11 23:13:05 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1692522881',display_name='tempest-ServerRescueNegativeTestJSON-server-1692522881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1692522881',id=23,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31c373270f804948a04c8125848fa181',ramdisk_id='',reservation_id='r-wpvajt0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-242021724',owner_user_name='tempest-ServerRescueNegativeTestJSON-242021724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:13:03Z,user_data=None,user_id='8d63779eda794ef0b2413ac1483f88b8',uuid=dd8aa618-99bb-49d7-b547-e5db4470f4c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converting VIF {"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:11:46,bridge_name='br-int',has_traffic_filtering=True,id=af81e577-93ac-47a7-8666-377d53fad5c2,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81e577-93') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG os_vif [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:11:46,bridge_name='br-int',has_traffic_filtering=True,id=af81e577-93ac-47a7-8666-377d53fad5c2,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81e577-93') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf81e577-93, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf81e577-93, col_values=(('external_ids', {'iface-id': 'af81e577-93ac-47a7-8666-377d53fad5c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:11:46', 'vm-uuid': 'dd8aa618-99bb-49d7-b547-e5db4470f4c6'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:05 user nova-compute[71516]: INFO os_vif [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:11:46,bridge_name='br-int',has_traffic_filtering=True,id=af81e577-93ac-47a7-8666-377d53fad5c2,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81e577-93')
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:13:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No VIF found with MAC fa:16:3e:24:11:46, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.network.neutron [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Updated VIF entry in instance network info cache for port af81e577-93ac-47a7-8666-377d53fad5c2. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.network.neutron [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Updating instance_info_cache with network_info: [{"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.network.neutron [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Successfully updated port: 6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] Releasing lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquired lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.network.neutron [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.network.neutron [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.network.neutron [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Updating instance_info_cache with network_info: [{"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Releasing lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Instance network_info: |[{"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Start _get_guest_xml network_info=[{"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:13:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:13:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-7248979',display_name='tempest-ServerRescueNegativeTestJSON-server-7248979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-7248979',id=24,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31c373270f804948a04c8125848fa181',ramdisk_id='',reservation_id='r-yo5jzi9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-242021724',owner_user_name='tempest-ServerRescueNegativeTestJSON-242021724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:13:04Z,user_data=None,user_id='8d63779eda794ef0b2413ac1483f88b8',uuid=61204bbb-04fb-4545-ade1-5665c733c5bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converting VIF {"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a9:e1,bridge_name='br-int',has_traffic_filtering=True,id=6eb4af06-413f-41c6-892b-f2d66653509f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb4af06-41') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.objects.instance [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'pci_devices' on Instance uuid 61204bbb-04fb-4545-ade1-5665c733c5bd {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:13:06 user nova-compute[71516]:   <uuid>61204bbb-04fb-4545-ade1-5665c733c5bd</uuid>
Apr 11 23:13:06 user nova-compute[71516]:   <name>instance-00000018</name>
Apr 11 23:13:06 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:13:06 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:13:06 user nova-compute[71516]:   <metadata>
Apr 11 23:13:06 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:13:06 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:13:06 user nova-compute[71516]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-7248979</nova:name>
Apr 11 23:13:06 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:13:06</nova:creationTime>
Apr 11 23:13:06 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:13:06 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:13:06 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:13:06 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:13:06 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:13:06 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:13:06 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:13:06 user nova-compute[71516]:       <nova:owner>
Apr 11 23:13:06 user nova-compute[71516]:         <nova:user uuid="8d63779eda794ef0b2413ac1483f88b8">tempest-ServerRescueNegativeTestJSON-242021724-project-member</nova:user>
Apr 11 23:13:06 user nova-compute[71516]:         <nova:project uuid="31c373270f804948a04c8125848fa181">tempest-ServerRescueNegativeTestJSON-242021724</nova:project>
Apr 11 23:13:06 user nova-compute[71516]:       </nova:owner>
Apr 11 23:13:06 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:13:06 user nova-compute[71516]:       <nova:ports>
Apr 11 23:13:06 user nova-compute[71516]:         <nova:port uuid="6eb4af06-413f-41c6-892b-f2d66653509f">
Apr 11 23:13:06 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:13:06 user nova-compute[71516]:         </nova:port>
Apr 11 23:13:06 user nova-compute[71516]:       </nova:ports>
Apr 11 23:13:06 user nova-compute[71516]:     </nova:instance>
Apr 11 23:13:06 user nova-compute[71516]:   </metadata>
Apr 11 23:13:06 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:13:06 user nova-compute[71516]:     <system>
Apr 11 23:13:06 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:13:06 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:13:06 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:13:06 user nova-compute[71516]:       <entry name="serial">61204bbb-04fb-4545-ade1-5665c733c5bd</entry>
Apr 11 23:13:06 user nova-compute[71516]:       <entry name="uuid">61204bbb-04fb-4545-ade1-5665c733c5bd</entry>
Apr 11 23:13:06 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:13:06 user nova-compute[71516]:     </system>
Apr 11 23:13:06 user nova-compute[71516]:   </sysinfo>
Apr 11 23:13:06 user nova-compute[71516]:   <os>
Apr 11 23:13:06 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:13:06 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:13:06 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:13:06 user nova-compute[71516]:   </os>
Apr 11 23:13:06 user nova-compute[71516]:   <features>
Apr 11 23:13:06 user nova-compute[71516]:     <acpi/>
Apr 11 23:13:06 user nova-compute[71516]:     <apic/>
Apr 11 23:13:06 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:13:06 user nova-compute[71516]:   </features>
Apr 11 23:13:06 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:13:06 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:13:06 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:13:06 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:13:06 user nova-compute[71516]:   </clock>
Apr 11 23:13:06 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:13:06 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:13:06 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:13:06 user nova-compute[71516]:   </cpu>
Apr 11 23:13:06 user nova-compute[71516]:   <devices>
Apr 11 23:13:06 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:13:06 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:13:06 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk"/>
Apr 11 23:13:06 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:13:06 user nova-compute[71516]:     </disk>
Apr 11 23:13:06 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:13:06 user nova-compute[71516]:       <mac address="fa:16:3e:8f:a9:e1"/>
Apr 11 23:13:06 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:13:06 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:13:06 user nova-compute[71516]:       <target dev="tap6eb4af06-41"/>
Apr 11 23:13:06 user nova-compute[71516]:     </interface>
Apr 11 23:13:06 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:13:06 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/console.log" append="off"/>
Apr 11 23:13:06 user nova-compute[71516]:     </serial>
Apr 11 23:13:06 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:13:06 user nova-compute[71516]:     <video>
Apr 11 23:13:06 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:13:06 user nova-compute[71516]:     </video>
Apr 11 23:13:06 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:13:06 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:13:06 user nova-compute[71516]:     </rng>
Apr 11 23:13:06 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:13:06 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:13:06 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:13:06 user nova-compute[71516]:     </memballoon>
Apr 11 23:13:06 user nova-compute[71516]:   </devices>
Apr 11 23:13:06 user nova-compute[71516]: </domain>
Apr 11 23:13:06 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-7248979',display_name='tempest-ServerRescueNegativeTestJSON-server-7248979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-7248979',id=24,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31c373270f804948a04c8125848fa181',ramdisk_id='',reservation_id='r-yo5jzi9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-242021724',owner_user_name='tempest-ServerRescueNegativeTestJSON-242021724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:13:04Z,user_data=None,user_id='8d63779eda794ef0b2413ac1483f88b8',uuid=61204bbb-04fb-4545-ade1-5665c733c5bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converting VIF {"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a9:e1,bridge_name='br-int',has_traffic_filtering=True,id=6eb4af06-413f-41c6-892b-f2d66653509f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb4af06-41') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG os_vif [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a9:e1,bridge_name='br-int',has_traffic_filtering=True,id=6eb4af06-413f-41c6-892b-f2d66653509f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb4af06-41') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6eb4af06-41, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6eb4af06-41, col_values=(('external_ids', {'iface-id': '6eb4af06-413f-41c6-892b-f2d66653509f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:a9:e1', 'vm-uuid': '61204bbb-04fb-4545-ade1-5665c733c5bd'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:13:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:06 user nova-compute[71516]: INFO os_vif [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a9:e1,bridge_name='br-int',has_traffic_filtering=True,id=6eb4af06-413f-41c6-892b-f2d66653509f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb4af06-41')
Apr 11 23:13:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No VIF found with MAC fa:16:3e:8f:a9:e1, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received event network-changed-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Refreshing instance network info cache due to event network-changed-6eb4af06-413f-41c6-892b-f2d66653509f. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] Acquiring lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] Acquired lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG nova.network.neutron [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Refreshing network info cache for port 6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-dd2ceaea-81c0-4367-ad69-f57ce68e03bf req-cdf3e41f-689c-4a1a-aaff-087b87f725ca service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dd2ceaea-81c0-4367-ad69-f57ce68e03bf req-cdf3e41f-689c-4a1a-aaff-087b87f725ca service nova] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dd2ceaea-81c0-4367-ad69-f57ce68e03bf req-cdf3e41f-689c-4a1a-aaff-087b87f725ca service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dd2ceaea-81c0-4367-ad69-f57ce68e03bf req-cdf3e41f-689c-4a1a-aaff-087b87f725ca service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-dd2ceaea-81c0-4367-ad69-f57ce68e03bf req-cdf3e41f-689c-4a1a-aaff-087b87f725ca service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] No waiting events found dispatching network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:07 user nova-compute[71516]: WARNING nova.compute.manager [req-dd2ceaea-81c0-4367-ad69-f57ce68e03bf req-cdf3e41f-689c-4a1a-aaff-087b87f725ca service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received unexpected event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 for instance with vm_state building and task_state spawning.
Apr 11 23:13:08 user nova-compute[71516]: DEBUG nova.network.neutron [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Updated VIF entry in instance network info cache for port 6eb4af06-413f-41c6-892b-f2d66653509f. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:13:08 user nova-compute[71516]: DEBUG nova.network.neutron [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Updating instance_info_cache with network_info: [{"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:13:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] Releasing lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:13:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:08 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254773.174717, 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:13:08 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] VM Stopped (Lifecycle Event)
Apr 11 23:13:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d6eeafac-f9d5-45ea-ba8e-8acfcefea7c2 None None] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] No waiting events found dispatching network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:09 user nova-compute[71516]: WARNING nova.compute.manager [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received unexpected event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 for instance with vm_state building and task_state spawning.
Apr 11 23:13:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received event network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] Acquiring lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] No waiting events found dispatching network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:09 user nova-compute[71516]: WARNING nova.compute.manager [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received unexpected event network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f for instance with vm_state building and task_state spawning.
Apr 11 23:13:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254790.623487, dd8aa618-99bb-49d7-b547-e5db4470f4c6 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:13:10 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] VM Resumed (Lifecycle Event)
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:13:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Instance spawned successfully.
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:13:10 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254790.6263938, dd8aa618-99bb-49d7-b547-e5db4470f4c6 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:13:10 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] VM Started (Lifecycle Event)
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:13:10 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:13:10 user nova-compute[71516]: INFO nova.compute.manager [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Took 7.45 seconds to spawn the instance on the hypervisor.
Apr 11 23:13:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:10 user nova-compute[71516]: INFO nova.compute.manager [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Took 8.11 seconds to build instance.
Apr 11 23:13:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.205s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254791.206922, 61204bbb-04fb-4545-ade1-5665c733c5bd => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:13:11 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] VM Resumed (Lifecycle Event)
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:13:11 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Instance spawned successfully.
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:11 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254791.2113385, 61204bbb-04fb-4545-ade1-5665c733c5bd => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:13:11 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] VM Started (Lifecycle Event)
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:13:11 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:13:11 user nova-compute[71516]: INFO nova.compute.manager [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Took 7.17 seconds to spawn the instance on the hypervisor.
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "410941af-9184-44ae-b416-b2a265c24f02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "410941af-9184-44ae-b416-b2a265c24f02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:13:11 user nova-compute[71516]: INFO nova.compute.manager [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Took 8.06 seconds to build instance.
Apr 11 23:13:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:13:11 user nova-compute[71516]: INFO nova.compute.claims [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Claim successful on node user
Apr 11 23:13:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.244s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-90dfe316-a26e-4c7d-bc2e-b66478f9daa5 req-ed285db7-47fe-4f85-8be6-1f2741cc0d6b service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received event network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-90dfe316-a26e-4c7d-bc2e-b66478f9daa5 req-ed285db7-47fe-4f85-8be6-1f2741cc0d6b service nova] Acquiring lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-90dfe316-a26e-4c7d-bc2e-b66478f9daa5 req-ed285db7-47fe-4f85-8be6-1f2741cc0d6b service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-90dfe316-a26e-4c7d-bc2e-b66478f9daa5 req-ed285db7-47fe-4f85-8be6-1f2741cc0d6b service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-90dfe316-a26e-4c7d-bc2e-b66478f9daa5 req-ed285db7-47fe-4f85-8be6-1f2741cc0d6b service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] No waiting events found dispatching network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:11 user nova-compute[71516]: WARNING nova.compute.manager [req-90dfe316-a26e-4c7d-bc2e-b66478f9daa5 req-ed285db7-47fe-4f85-8be6-1f2741cc0d6b service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received unexpected event network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f for instance with vm_state active and task_state None.
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:13:12 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:13:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG nova.policy [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3995d8045154666b0ae890dd3de5ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154fad18f802436d95b15503e470d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:13:12 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Creating image(s)
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "/opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "/opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "/opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.194s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk 1073741824" returned: 0 in 0.188s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.163s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Checking if we can resize image /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:13:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Successfully created port: ad12511e-bbda-4cfd-9ea9-093053aedb3e {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Cannot resize image /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'migration_context' on Instance uuid 410941af-9184-44ae-b416-b2a265c24f02 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Ensure instance console log exists: /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Successfully updated port: ad12511e-bbda-4cfd-9ea9-093053aedb3e {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "refresh_cache-410941af-9184-44ae-b416-b2a265c24f02" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquired lock "refresh_cache-410941af-9184-44ae-b416-b2a265c24f02" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Received event network-changed-ad12511e-bbda-4cfd-9ea9-093053aedb3e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Refreshing instance network info cache due to event network-changed-ad12511e-bbda-4cfd-9ea9-093053aedb3e. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] Acquiring lock "refresh_cache-410941af-9184-44ae-b416-b2a265c24f02" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:13:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Updating instance_info_cache with network_info: [{"id": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "address": "fa:16:3e:1e:24:83", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad12511e-bb", "ovs_interfaceid": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Releasing lock "refresh_cache-410941af-9184-44ae-b416-b2a265c24f02" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Instance network_info: |[{"id": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "address": "fa:16:3e:1e:24:83", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad12511e-bb", "ovs_interfaceid": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] Acquired lock "refresh_cache-410941af-9184-44ae-b416-b2a265c24f02" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.network.neutron [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Refreshing network info cache for port ad12511e-bbda-4cfd-9ea9-093053aedb3e {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Start _get_guest_xml network_info=[{"id": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "address": "fa:16:3e:1e:24:83", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad12511e-bb", "ovs_interfaceid": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:13:14 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:13:14 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-970336588',display_name='tempest-VolumesSnapshotTestJSON-instance-970336588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-970336588',id=25,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='154fad18f802436d95b15503e470d942',ramdisk_id='',reservation_id='r-vq7oss3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-76917881',owner_user_name='tempest-VolumesSnapshotTestJSON-76917881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:13:12Z,user_data=None,user_id='e3995d8045154666b0ae890dd3de5ef3',uuid=410941af-9184-44ae-b416-b2a265c24f02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "address": "fa:16:3e:1e:24:83", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad12511e-bb", "ovs_interfaceid": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Converting VIF {"id": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "address": "fa:16:3e:1e:24:83", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad12511e-bb", "ovs_interfaceid": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:24:83,bridge_name='br-int',has_traffic_filtering=True,id=ad12511e-bbda-4cfd-9ea9-093053aedb3e,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad12511e-bb') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'pci_devices' on Instance uuid 410941af-9184-44ae-b416-b2a265c24f02 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:13:14 user nova-compute[71516]:   <uuid>410941af-9184-44ae-b416-b2a265c24f02</uuid>
Apr 11 23:13:14 user nova-compute[71516]:   <name>instance-00000019</name>
Apr 11 23:13:14 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:13:14 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:13:14 user nova-compute[71516]:   <metadata>
Apr 11 23:13:14 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:13:14 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:13:14 user nova-compute[71516]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-970336588</nova:name>
Apr 11 23:13:14 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:13:14</nova:creationTime>
Apr 11 23:13:14 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:13:14 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:13:14 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:13:14 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:13:14 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:13:14 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:13:14 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:13:14 user nova-compute[71516]:       <nova:owner>
Apr 11 23:13:14 user nova-compute[71516]:         <nova:user uuid="e3995d8045154666b0ae890dd3de5ef3">tempest-VolumesSnapshotTestJSON-76917881-project-member</nova:user>
Apr 11 23:13:14 user nova-compute[71516]:         <nova:project uuid="154fad18f802436d95b15503e470d942">tempest-VolumesSnapshotTestJSON-76917881</nova:project>
Apr 11 23:13:14 user nova-compute[71516]:       </nova:owner>
Apr 11 23:13:14 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:13:14 user nova-compute[71516]:       <nova:ports>
Apr 11 23:13:14 user nova-compute[71516]:         <nova:port uuid="ad12511e-bbda-4cfd-9ea9-093053aedb3e">
Apr 11 23:13:14 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:13:14 user nova-compute[71516]:         </nova:port>
Apr 11 23:13:14 user nova-compute[71516]:       </nova:ports>
Apr 11 23:13:14 user nova-compute[71516]:     </nova:instance>
Apr 11 23:13:14 user nova-compute[71516]:   </metadata>
Apr 11 23:13:14 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:13:14 user nova-compute[71516]:     <system>
Apr 11 23:13:14 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:13:14 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:13:14 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:13:14 user nova-compute[71516]:       <entry name="serial">410941af-9184-44ae-b416-b2a265c24f02</entry>
Apr 11 23:13:14 user nova-compute[71516]:       <entry name="uuid">410941af-9184-44ae-b416-b2a265c24f02</entry>
Apr 11 23:13:14 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:13:14 user nova-compute[71516]:     </system>
Apr 11 23:13:14 user nova-compute[71516]:   </sysinfo>
Apr 11 23:13:14 user nova-compute[71516]:   <os>
Apr 11 23:13:14 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:13:14 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:13:14 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:13:14 user nova-compute[71516]:   </os>
Apr 11 23:13:14 user nova-compute[71516]:   <features>
Apr 11 23:13:14 user nova-compute[71516]:     <acpi/>
Apr 11 23:13:14 user nova-compute[71516]:     <apic/>
Apr 11 23:13:14 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:13:14 user nova-compute[71516]:   </features>
Apr 11 23:13:14 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:13:14 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:13:14 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:13:14 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:13:14 user nova-compute[71516]:   </clock>
Apr 11 23:13:14 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:13:14 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:13:14 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:13:14 user nova-compute[71516]:   </cpu>
Apr 11 23:13:14 user nova-compute[71516]:   <devices>
Apr 11 23:13:14 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:13:14 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:13:14 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk"/>
Apr 11 23:13:14 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:13:14 user nova-compute[71516]:     </disk>
Apr 11 23:13:14 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:13:14 user nova-compute[71516]:       <mac address="fa:16:3e:1e:24:83"/>
Apr 11 23:13:14 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:13:14 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:13:14 user nova-compute[71516]:       <target dev="tapad12511e-bb"/>
Apr 11 23:13:14 user nova-compute[71516]:     </interface>
Apr 11 23:13:14 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:13:14 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/console.log" append="off"/>
Apr 11 23:13:14 user nova-compute[71516]:     </serial>
Apr 11 23:13:14 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:13:14 user nova-compute[71516]:     <video>
Apr 11 23:13:14 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:13:14 user nova-compute[71516]:     </video>
Apr 11 23:13:14 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:13:14 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:13:14 user nova-compute[71516]:     </rng>
Apr 11 23:13:14 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:13:14 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:13:14 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:13:14 user nova-compute[71516]:     </memballoon>
Apr 11 23:13:14 user nova-compute[71516]:   </devices>
Apr 11 23:13:14 user nova-compute[71516]: </domain>
Apr 11 23:13:14 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-970336588',display_name='tempest-VolumesSnapshotTestJSON-instance-970336588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-970336588',id=25,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='154fad18f802436d95b15503e470d942',ramdisk_id='',reservation_id='r-vq7oss3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-76917881',owner_user_name='tempest-VolumesSnapshotTestJSON-76917881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:13:12Z,user_data=None,user_id='e3995d8045154666b0ae890dd3de5ef3',uuid=410941af-9184-44ae-b416-b2a265c24f02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "address": "fa:16:3e:1e:24:83", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad12511e-bb", "ovs_interfaceid": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Converting VIF {"id": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "address": "fa:16:3e:1e:24:83", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad12511e-bb", "ovs_interfaceid": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:24:83,bridge_name='br-int',has_traffic_filtering=True,id=ad12511e-bbda-4cfd-9ea9-093053aedb3e,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad12511e-bb') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG os_vif [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:24:83,bridge_name='br-int',has_traffic_filtering=True,id=ad12511e-bbda-4cfd-9ea9-093053aedb3e,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad12511e-bb') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad12511e-bb, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad12511e-bb, col_values=(('external_ids', {'iface-id': 'ad12511e-bbda-4cfd-9ea9-093053aedb3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:24:83', 'vm-uuid': '410941af-9184-44ae-b416-b2a265c24f02'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:14 user nova-compute[71516]: INFO os_vif [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:24:83,bridge_name='br-int',has_traffic_filtering=True,id=ad12511e-bbda-4cfd-9ea9-093053aedb3e,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad12511e-bb')
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] No VIF found with MAC fa:16:3e:1e:24:83, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.network.neutron [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Updated VIF entry in instance network info cache for port ad12511e-bbda-4cfd-9ea9-093053aedb3e. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG nova.network.neutron [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Updating instance_info_cache with network_info: [{"id": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "address": "fa:16:3e:1e:24:83", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad12511e-bb", "ovs_interfaceid": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:13:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] Releasing lock "refresh_cache-410941af-9184-44ae-b416-b2a265c24f02" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:13:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-403a7c70-a74e-43d1-8fee-c165404c2bde req-efaea758-4c78-42f0-96b6-08d2d3a46856 service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Received event network-vif-plugged-ad12511e-bbda-4cfd-9ea9-093053aedb3e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-403a7c70-a74e-43d1-8fee-c165404c2bde req-efaea758-4c78-42f0-96b6-08d2d3a46856 service nova] Acquiring lock "410941af-9184-44ae-b416-b2a265c24f02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-403a7c70-a74e-43d1-8fee-c165404c2bde req-efaea758-4c78-42f0-96b6-08d2d3a46856 service nova] Lock "410941af-9184-44ae-b416-b2a265c24f02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-403a7c70-a74e-43d1-8fee-c165404c2bde req-efaea758-4c78-42f0-96b6-08d2d3a46856 service nova] Lock "410941af-9184-44ae-b416-b2a265c24f02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-403a7c70-a74e-43d1-8fee-c165404c2bde req-efaea758-4c78-42f0-96b6-08d2d3a46856 service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] No waiting events found dispatching network-vif-plugged-ad12511e-bbda-4cfd-9ea9-093053aedb3e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:16 user nova-compute[71516]: WARNING nova.compute.manager [req-403a7c70-a74e-43d1-8fee-c165404c2bde req-efaea758-4c78-42f0-96b6-08d2d3a46856 service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Received unexpected event network-vif-plugged-ad12511e-bbda-4cfd-9ea9-093053aedb3e for instance with vm_state building and task_state spawning.
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254797.8768158, 410941af-9184-44ae-b416-b2a265c24f02 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:13:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 410941af-9184-44ae-b416-b2a265c24f02] VM Resumed (Lifecycle Event)
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:13:17 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Instance spawned successfully.
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 410941af-9184-44ae-b416-b2a265c24f02] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254797.8781743, 410941af-9184-44ae-b416-b2a265c24f02 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:13:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 410941af-9184-44ae-b416-b2a265c24f02] VM Started (Lifecycle Event)
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:13:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 410941af-9184-44ae-b416-b2a265c24f02] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:13:17 user nova-compute[71516]: INFO nova.compute.manager [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Took 5.72 seconds to spawn the instance on the hypervisor.
Apr 11 23:13:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:18 user nova-compute[71516]: INFO nova.compute.manager [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Took 6.61 seconds to build instance.
Apr 11 23:13:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-0bc0c9ab-3077-4c07-b43d-d45320a2c5a9 req-e2cdc7cc-38fe-48cc-bbc9-df1d0478a4ae service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Received event network-vif-plugged-ad12511e-bbda-4cfd-9ea9-093053aedb3e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0bc0c9ab-3077-4c07-b43d-d45320a2c5a9 req-e2cdc7cc-38fe-48cc-bbc9-df1d0478a4ae service nova] Acquiring lock "410941af-9184-44ae-b416-b2a265c24f02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0bc0c9ab-3077-4c07-b43d-d45320a2c5a9 req-e2cdc7cc-38fe-48cc-bbc9-df1d0478a4ae service nova] Lock "410941af-9184-44ae-b416-b2a265c24f02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0bc0c9ab-3077-4c07-b43d-d45320a2c5a9 req-e2cdc7cc-38fe-48cc-bbc9-df1d0478a4ae service nova] Lock "410941af-9184-44ae-b416-b2a265c24f02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-0bc0c9ab-3077-4c07-b43d-d45320a2c5a9 req-e2cdc7cc-38fe-48cc-bbc9-df1d0478a4ae service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] No waiting events found dispatching network-vif-plugged-ad12511e-bbda-4cfd-9ea9-093053aedb3e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:18 user nova-compute[71516]: WARNING nova.compute.manager [req-0bc0c9ab-3077-4c07-b43d-d45320a2c5a9 req-e2cdc7cc-38fe-48cc-bbc9-df1d0478a4ae service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Received unexpected event network-vif-plugged-ad12511e-bbda-4cfd-9ea9-093053aedb3e for instance with vm_state building and task_state spawning.
Apr 11 23:13:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "410941af-9184-44ae-b416-b2a265c24f02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.734s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:23 user nova-compute[71516]: INFO nova.compute.manager [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Terminating instance
Apr 11 23:13:23 user nova-compute[71516]: DEBUG nova.compute.manager [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG nova.compute.manager [req-884bca4a-11fa-4037-9d4a-b189c939d27e req-cf44e1b4-3c69-4756-98b1-46fea046f370 service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Received event network-vif-unplugged-d32a4080-99bc-415f-8ab8-27b11a4658b4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-884bca4a-11fa-4037-9d4a-b189c939d27e req-cf44e1b4-3c69-4756-98b1-46fea046f370 service nova] Acquiring lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-884bca4a-11fa-4037-9d4a-b189c939d27e req-cf44e1b4-3c69-4756-98b1-46fea046f370 service nova] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-884bca4a-11fa-4037-9d4a-b189c939d27e req-cf44e1b4-3c69-4756-98b1-46fea046f370 service nova] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG nova.compute.manager [req-884bca4a-11fa-4037-9d4a-b189c939d27e req-cf44e1b4-3c69-4756-98b1-46fea046f370 service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] No waiting events found dispatching network-vif-unplugged-d32a4080-99bc-415f-8ab8-27b11a4658b4 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:23 user nova-compute[71516]: DEBUG nova.compute.manager [req-884bca4a-11fa-4037-9d4a-b189c939d27e req-cf44e1b4-3c69-4756-98b1-46fea046f370 service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Received event network-vif-unplugged-d32a4080-99bc-415f-8ab8-27b11a4658b4 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:13:24 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Instance destroyed successfully.
Apr 11 23:13:24 user nova-compute[71516]: DEBUG nova.objects.instance [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lazy-loading 'resources' on Instance uuid ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1843582430',display_name='tempest-ServersNegativeTestJSON-server-1843582430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1843582430',id=1,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c3e11fd040149dd8f5a130a9682a59c',ramdisk_id='',reservation_id='r-bz0bw7l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1318055293',owner_user_name='tempest-ServersNegativeTestJSON-1318055293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:04:58Z,user_data=None,user_id='859ae6c19707455ebf82bf532c9e10c0',uuid=ede8a4b9-1d26-4090-a968-a90bdd5fc2c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "address": "fa:16:3e:28:ea:b9", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32a4080-99", "ovs_interfaceid": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Converting VIF {"id": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "address": "fa:16:3e:28:ea:b9", "network": {"id": "02021ebc-33d0-4630-a873-2190cd8d8360", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-41120849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3e11fd040149dd8f5a130a9682a59c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32a4080-99", "ovs_interfaceid": "d32a4080-99bc-415f-8ab8-27b11a4658b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=d32a4080-99bc-415f-8ab8-27b11a4658b4,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32a4080-99') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG os_vif [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=d32a4080-99bc-415f-8ab8-27b11a4658b4,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32a4080-99') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd32a4080-99, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:13:24 user nova-compute[71516]: INFO os_vif [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:ea:b9,bridge_name='br-int',has_traffic_filtering=True,id=d32a4080-99bc-415f-8ab8-27b11a4658b4,network=Network(02021ebc-33d0-4630-a873-2190cd8d8360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32a4080-99')
Apr 11 23:13:24 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Deleting instance files /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9_del
Apr 11 23:13:24 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Deletion of /opt/stack/data/nova/instances/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9_del complete
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG nova.objects.instance [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'flavor' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:24 user nova-compute[71516]: INFO nova.compute.manager [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:24 user nova-compute[71516]: INFO nova.compute.manager [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Attaching volume acc3f3e9-087d-4fc0-a462-78564949fef5 to /dev/vdb
Apr 11 23:13:24 user nova-compute[71516]: DEBUG os_brick.utils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6350e4-508c-4426-88d3-7e0fe32723f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.038s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a583fc-418a-491e-9675-f55cf00d54fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b7ec26-f3f2-470e-82bb-3e07c4c966ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[277da8ea-e195-4cc3-9220-5d0adf4b8964]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:13:24 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:13:24 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[057fe61b-7015-4f37-9c41-c0a79470fc53]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG os_brick.utils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating existing volume attachment record: ca503c48-6663-45ef-b76d-d9478c71dc73 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:13:24 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:13:25 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Took 0.67 seconds to deallocate network for instance.
Apr 11 23:13:25 user nova-compute[71516]: DEBUG nova.compute.manager [req-aef8e136-3be8-47a5-a9c8-4d96c9903a49 req-b9214386-f85c-4c5e-8b9b-5ade8fcbc265 service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Received event network-vif-deleted-d32a4080-99bc-415f-8ab8-27b11a4658b4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:25 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:13:25 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:13:25 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:13:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:25 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Deleted allocations for instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9
Apr 11 23:13:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.174s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:25 user nova-compute[71516]: DEBUG nova.compute.manager [req-8cd7dcb7-f108-4406-9436-c3dada6708cc req-5fe3951e-1a72-4ac0-86a3-67df6562415b service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Received event network-vif-plugged-d32a4080-99bc-415f-8ab8-27b11a4658b4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8cd7dcb7-f108-4406-9436-c3dada6708cc req-5fe3951e-1a72-4ac0-86a3-67df6562415b service nova] Acquiring lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8cd7dcb7-f108-4406-9436-c3dada6708cc req-5fe3951e-1a72-4ac0-86a3-67df6562415b service nova] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8cd7dcb7-f108-4406-9436-c3dada6708cc req-5fe3951e-1a72-4ac0-86a3-67df6562415b service nova] Lock "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:25 user nova-compute[71516]: DEBUG nova.compute.manager [req-8cd7dcb7-f108-4406-9436-c3dada6708cc req-5fe3951e-1a72-4ac0-86a3-67df6562415b service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] No waiting events found dispatching network-vif-plugged-d32a4080-99bc-415f-8ab8-27b11a4658b4 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:25 user nova-compute[71516]: WARNING nova.compute.manager [req-8cd7dcb7-f108-4406-9436-c3dada6708cc req-5fe3951e-1a72-4ac0-86a3-67df6562415b service nova] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Received unexpected event network-vif-plugged-d32a4080-99bc-415f-8ab8-27b11a4658b4 for instance with vm_state deleted and task_state None.
Apr 11 23:13:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:13:28 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:13:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-f2a79a44-800e-4142-b778-aae06a5c779d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:13:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-f2a79a44-800e-4142-b778-aae06a5c779d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:13:28 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:13:28 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Updating instance_info_cache with network_info: [{"id": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "address": "fa:16:3e:16:12:b6", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970d841b-bb", "ovs_interfaceid": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:13:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-f2a79a44-800e-4142-b778-aae06a5c779d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:13:28 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:13:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:13:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:28 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:13:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peWsXVHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:13:29 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:13:29 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:13:29 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87d597e-e775-407f-aad6-ec9fa243f8a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:13:29 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[da274177-c07a-42fe-b335-255cf604142d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5] added
Apr 11 23:13:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eb0f07-13b8-4ef3-be86-35af5299f73a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b7b805-217c-40a3-97e2-fa6b21002f37]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peWsXVHc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peWsXVHc" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[de74bdc5-7416-4ef0-ad28-e367abac6353]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'peWsXVHc'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d90fdb4-2ec7-418f-b697-a3d46d0e4c4c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ed1982-044c-45d9-a034-415407db0da3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:13:29 user nova-compute[71516]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:13:29 user nova-compute[71516]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a398cf33-c2f9-4489-ada5-61dbe1f0f183]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260]
Apr 11 23:13:29 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260] successful.
Apr 11 23:13:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed1d9fa-7db8-4e27-97bc-96f3017e9795]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[201ffad2-be3c-4a77-a25f-5dee5a43e070]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:13:29 user nova-compute[71516]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:29 user nova-compute[71516]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:13:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:13:29 user nova-compute[71516]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:29 user nova-compute[71516]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:13:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb2eefc-3977-4fba-ad15-49fa03292548]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peWsXVHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23065616566336562', 'path': '/dev/sdb'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065616566336562', 'path': '/dev/sdb'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG nova.objects.instance [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'flavor' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:13:30 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:13:30 user nova-compute[71516]:   <source dev="/dev/sdb"/>
Apr 11 23:13:30 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:13:30 user nova-compute[71516]:   <serial>acc3f3e9-087d-4fc0-a462-78564949fef5</serial>
Apr 11 23:13:30 user nova-compute[71516]: </disk>
Apr 11 23:13:30 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No VIF found with MAC fa:16:3e:ec:10:5e, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:13:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.564s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:13:31 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:13:31 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:13:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=7720MB free_disk=26.350074768066406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f2a79a44-800e-4142-b778-aae06a5c779d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e4d31874-4273-48bc-8811-89832d18b893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 410941af-9184-44ae-b416-b2a265c24f02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:13:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:13:32 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:13:32 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:13:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:13:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Stashing vm_state: active {{(pid=71516) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'pci_requests' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:13:33 user nova-compute[71516]: INFO nova.compute.claims [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Claim successful on node user
Apr 11 23:13:33 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'resources' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f2a79a44-800e-4142-b778-aae06a5c779d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2a79a44-800e-4142-b778-aae06a5c779d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'pci_devices' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:33 user nova-compute[71516]: INFO nova.compute.manager [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Detaching volume 0495c378-b313-45ae-9438-2c19c513e9ee
Apr 11 23:13:33 user nova-compute[71516]: INFO nova.compute.resource_tracker [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating resource usage from migration 42989b85-5137-41a1-a2f6-d2c7aae7cf5e
Apr 11 23:13:33 user nova-compute[71516]: INFO nova.virt.block_device [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Attempting to driver detach volume 0495c378-b313-45ae-9438-2c19c513e9ee from mountpoint /dev/vdb
Apr 11 23:13:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Attempting to detach device vdb from instance f2a79a44-800e-4142-b778-aae06a5c779d from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:13:33 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:13:33 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:13:33 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:13:33 user nova-compute[71516]:   <serial>0495c378-b313-45ae-9438-2c19c513e9ee</serial>
Apr 11 23:13:33 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:13:33 user nova-compute[71516]: </disk>
Apr 11 23:13:33 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:13:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully detached device vdb from instance f2a79a44-800e-4142-b778-aae06a5c779d from the persistent domain config.
Apr 11 23:13:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2a79a44-800e-4142-b778-aae06a5c779d from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:13:33 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:13:33 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:13:33 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:13:33 user nova-compute[71516]:   <serial>0495c378-b313-45ae-9438-2c19c513e9ee</serial>
Apr 11 23:13:33 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:13:33 user nova-compute[71516]: </disk>
Apr 11 23:13:33 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.412s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:33 user nova-compute[71516]: INFO nova.compute.manager [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Migrating
Apr 11 23:13:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:13:33 user nova-compute[71516]: INFO nova.compute.rpcapi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 11 23:13:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquired lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:13:33 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681254814.0554686, f2a79a44-800e-4142-b778-aae06a5c779d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2a79a44-800e-4142-b778-aae06a5c779d {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:13:34 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully detached device vdb from instance f2a79a44-800e-4142-b778-aae06a5c779d from the live domain config.
Apr 11 23:13:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hmSYawFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:13:34 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2c7ae7-5579-49a6-8c54-de9ba9f14a77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:13:34 user nova-compute[71516]: No targets found.
Apr 11 23:13:34 user nova-compute[71516]: iSNS:
Apr 11 23:13:34 user nova-compute[71516]: No targets found.
Apr 11 23:13:34 user nova-compute[71516]: STATIC:
Apr 11 23:13:34 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5
Apr 11 23:13:34 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:13:34 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:13:34 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68
Apr 11 23:13:34 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:13:34 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:13:34 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee
Apr 11 23:13:34 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:13:34 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:13:34 user nova-compute[71516]: FIRMWARE:
Apr 11 23:13:34 user nova-compute[71516]: No targets found.
Apr 11 23:13:34 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:13:34 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:13:34 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcfda75-a102-4210-8df9-6a5ebfb5bada]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9850eab-8989-4303-889e-1a65d4c84961]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:13:34 user nova-compute[71516]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:34 user nova-compute[71516]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:13:34 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee (non-flash)
Apr 11 23:13:34 user nova-compute[71516]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:34 user nova-compute[71516]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:13:34 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c433490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee'): ({'sde'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Removing single pathed devices sde {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[005ac500-3594-4477-9cc4-5c8fbb61faa8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff72ca64-6c57-414a-9e8a-b21e856fa1d9]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flushing IO for device /dev/sde {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebdf1b0-d226-4eb9-a410-3340df2f9c0f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7701a4-a99e-4c5e-bbee-c020bc1bce2d]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[757a9029-dc8e-4df5-b5b1-82133c7eefc0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5ac517-307c-472b-b33a-74ed07879b18]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee, portal: 172.16.0.220,3260]
Apr 11 23:13:34 user nova-compute[71516]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee, portal: 172.16.0.220,3260] successful.
Apr 11 23:13:34 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0495c378-b313-45ae-9438-2c19c513e9ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70c83c0-2552-486a-9caf-783ab05ccd08]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] <== disconnect_volume: return (302ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating instance_info_cache with network_info: [{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Releasing lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Starting migrate_disk_and_power_off {{(pid=71516) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG nova.compute.manager [req-2d7bab44-0927-4025-b5a3-2b66e5a788a0 req-5ce8870e-38f2-45b7-bd04-240a17465722 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-unplugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2d7bab44-0927-4025-b5a3-2b66e5a788a0 req-5ce8870e-38f2-45b7-bd04-240a17465722 service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2d7bab44-0927-4025-b5a3-2b66e5a788a0 req-5ce8870e-38f2-45b7-bd04-240a17465722 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2d7bab44-0927-4025-b5a3-2b66e5a788a0 req-5ce8870e-38f2-45b7-bd04-240a17465722 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:34 user nova-compute[71516]: DEBUG nova.compute.manager [req-2d7bab44-0927-4025-b5a3-2b66e5a788a0 req-5ce8870e-38f2-45b7-bd04-240a17465722 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-unplugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:34 user nova-compute[71516]: WARNING nova.compute.manager [req-2d7bab44-0927-4025-b5a3-2b66e5a788a0 req-5ce8870e-38f2-45b7-bd04-240a17465722 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-unplugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state active and task_state resize_migrating.
Apr 11 23:13:35 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'flavor' on Instance uuid f2a79a44-800e-4142-b778-aae06a5c779d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2a79a44-800e-4142-b778-aae06a5c779d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.723s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:35 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance destroyed successfully.
Apr 11 23:13:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1831107086',display_name='tempest-ServerActionsTestJSON-server-1247380178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1831107086',id=2,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-pn29cvap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:13:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=eed8cea5-9e5c-4467-8993-456cb3235fd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:ec:10:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:ec:10:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_vif [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap961d8195-c0, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:13:35 user nova-compute[71516]: INFO os_vif [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0')
Apr 11 23:13:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peWsXVHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:13:35 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b829a6-4301-4f52-a662-78bc6ea550a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:13:35 user nova-compute[71516]: No targets found.
Apr 11 23:13:35 user nova-compute[71516]: iSNS:
Apr 11 23:13:35 user nova-compute[71516]: No targets found.
Apr 11 23:13:35 user nova-compute[71516]: STATIC:
Apr 11 23:13:35 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5
Apr 11 23:13:35 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:13:35 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:13:35 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68
Apr 11 23:13:35 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:13:35 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:13:35 user nova-compute[71516]: FIRMWARE:
Apr 11 23:13:35 user nova-compute[71516]: No targets found.
Apr 11 23:13:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:13:35 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:13:35 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8c686d-d55b-4c95-b74c-3c0911e0d2f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[126d8921-9cab-4ed9-aa1d-2d980414d437]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:35 user nova-compute[71516]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:13:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:35 user nova-compute[71516]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:13:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5fd4aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5'): ({'sdb'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Removing single pathed devices sdb {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fecda21-b0ab-4ee1-aa1b-f66153c16e08]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17b371b-6728-4752-a2f0-7614adee8916]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flushing IO for device /dev/sdb {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dae6aa-8c56-43fb-85b6-03cb9d451e10]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70b7b86-8c90-4b1d-8243-f6fbaa49154b]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[946edb39-2404-485b-a654-81b073d70c90]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5f7961-d9a2-4dc7-b065-0962994197c0]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260]
Apr 11 23:13:35 user nova-compute[71516]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260] successful.
Apr 11 23:13:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0571ae-cc9d-4119-9b42-53300d4033f3]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== disconnect_volume: return (279ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:13:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8_resize/disk /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "cp -r /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8_resize/disk /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk" returned: 0 in 0.422s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8_resize/disk.info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk.info {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "cp -r /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8_resize/disk.info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk.info" returned: 0 in 0.047s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-4bdcbfc3-ae44-48cd-a3a8-6b2bfb48b960 req-35ed90bf-0376-41cc-85d9-3953b4e4eb32 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4bdcbfc3-ae44-48cd-a3a8-6b2bfb48b960 req-35ed90bf-0376-41cc-85d9-3953b4e4eb32 service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4bdcbfc3-ae44-48cd-a3a8-6b2bfb48b960 req-35ed90bf-0376-41cc-85d9-3953b4e4eb32 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4bdcbfc3-ae44-48cd-a3a8-6b2bfb48b960 req-35ed90bf-0376-41cc-85d9-3953b4e4eb32 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-4bdcbfc3-ae44-48cd-a3a8-6b2bfb48b960 req-35ed90bf-0376-41cc-85d9-3953b4e4eb32 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:36 user nova-compute[71516]: WARNING nova.compute.manager [req-4bdcbfc3-ae44-48cd-a3a8-6b2bfb48b960 req-35ed90bf-0376-41cc-85d9-3953b4e4eb32 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state active and task_state resize_migrating.
Apr 11 23:13:37 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Port 961d8195-c0d7-49eb-bfd7-05ee4b3e6112 binding to destination host user is already ACTIVE {{(pid=71516) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 23:13:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:13:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquired lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:13:37 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating instance_info_cache with network_info: [{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Releasing lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG os_brick.utils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c42d92-94df-4bd3-9887-36ee33f2cace]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[237049c4-7cb3-4b84-8a4a-8d165a44f0cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbac285b-680c-4d4f-98f0-a4f9ddcd83b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3cff94-bcf6-455c-80e6-54c0fe86a8c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:13:38 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:13:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35fa1ca-1283-4ea4-bc89-bc30a20a9361]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:13:38 user nova-compute[71516]: DEBUG os_brick.utils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:13:39 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:13:39 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254804.1977475, ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:13:39 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] VM Stopped (Lifecycle Event)
Apr 11 23:13:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-16fff46a-c4d1-4e43-901e-11a4be39d838 None None] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Starting finish_migration {{(pid=71516) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance directory exists: not creating {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 23:13:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Creating image(s)
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'trusted_certs' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Cannot resize image /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Ensure instance console log exists: /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Start _get_guest_xml network_info=[{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:ec:10:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peWsXVHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'eed8cea5-9e5c-4467-8993-456cb3235fd8', 'attached_at': '2023-04-11T23:13:42.000000', 'detached_at': '', 'volume_id': 'acc3f3e9-087d-4fc0-a462-78564949fef5', 'serial': 'acc3f3e9-087d-4fc0-a462-78564949fef5'}, 'disk_bus': 'virtio', 'attachment_id': 'bfe59b60-36c4-49bf-8643-79b638892415', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:13:42 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:13:42 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'vcpu_model' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peWsXVHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:13:42 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:13:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:13:42 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:13:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:13:42 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddca209-ed21-43eb-8f9b-187c90425ebb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:13:42 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7acb502-89e7-47a3-9c47-cf809533c69a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5] added
Apr 11 23:13:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08dc1ab-76f3-4ff8-bc8e-52783c001e13]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fc815e-c398-43d6-b4d2-977dba0b4403]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peWsXVHc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peWsXVHc" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f7ed16-f8c5-4020-a965-980b8cab9e98]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'peWsXVHc'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[968ac6fd-0911-4289-b427-2ae557160161]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9722ee41-211a-40d0-a0a0-69dc14639250]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:43 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:43 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dfb26e-db2c-4553-8efb-89fe1bbe2e34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260]
Apr 11 23:13:43 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260] successful.
Apr 11 23:13:43 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aad8031-c8c9-4ee1-8bdf-a814242f846e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f93b298-d9e5-42e9-a52b-9c4657e4ef9d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:43 user nova-compute[71516]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:13:43 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:43 user nova-compute[71516]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:13:43 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e211c93-a98d-47e3-833e-1fdf33aaca04]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:13:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peWsXVHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23065616566336562', 'path': '/dev/sdb'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065616566336562', 'path': '/dev/sdb'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1831107086',display_name='tempest-ServerActionsTestJSON-server-1247380178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1831107086',id=2,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-pn29cvap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=eed8cea5-9e5c-4467-8993-456cb3235fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:ec:10:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:ec:10:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:13:44 user nova-compute[71516]:   <uuid>eed8cea5-9e5c-4467-8993-456cb3235fd8</uuid>
Apr 11 23:13:44 user nova-compute[71516]:   <name>instance-00000002</name>
Apr 11 23:13:44 user nova-compute[71516]:   <memory>196608</memory>
Apr 11 23:13:44 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:13:44 user nova-compute[71516]:   <metadata>
Apr 11 23:13:44 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:13:44 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:13:44 user nova-compute[71516]:       <nova:name>tempest-ServerActionsTestJSON-server-1247380178</nova:name>
Apr 11 23:13:44 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:13:42</nova:creationTime>
Apr 11 23:13:44 user nova-compute[71516]:       <nova:flavor name="m1.micro">
Apr 11 23:13:44 user nova-compute[71516]:         <nova:memory>192</nova:memory>
Apr 11 23:13:44 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:13:44 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:13:44 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:13:44 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:13:44 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:13:44 user nova-compute[71516]:       <nova:owner>
Apr 11 23:13:44 user nova-compute[71516]:         <nova:user uuid="ddc7eb14e7174babb8680b4020243c97">tempest-ServerActionsTestJSON-813592275-project-member</nova:user>
Apr 11 23:13:44 user nova-compute[71516]:         <nova:project uuid="2fca37343b414de6b008ad79e022f858">tempest-ServerActionsTestJSON-813592275</nova:project>
Apr 11 23:13:44 user nova-compute[71516]:       </nova:owner>
Apr 11 23:13:44 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:13:44 user nova-compute[71516]:       <nova:ports>
Apr 11 23:13:44 user nova-compute[71516]:         <nova:port uuid="961d8195-c0d7-49eb-bfd7-05ee4b3e6112">
Apr 11 23:13:44 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:13:44 user nova-compute[71516]:         </nova:port>
Apr 11 23:13:44 user nova-compute[71516]:       </nova:ports>
Apr 11 23:13:44 user nova-compute[71516]:     </nova:instance>
Apr 11 23:13:44 user nova-compute[71516]:   </metadata>
Apr 11 23:13:44 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:13:44 user nova-compute[71516]:     <system>
Apr 11 23:13:44 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:13:44 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:13:44 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:13:44 user nova-compute[71516]:       <entry name="serial">eed8cea5-9e5c-4467-8993-456cb3235fd8</entry>
Apr 11 23:13:44 user nova-compute[71516]:       <entry name="uuid">eed8cea5-9e5c-4467-8993-456cb3235fd8</entry>
Apr 11 23:13:44 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:13:44 user nova-compute[71516]:     </system>
Apr 11 23:13:44 user nova-compute[71516]:   </sysinfo>
Apr 11 23:13:44 user nova-compute[71516]:   <os>
Apr 11 23:13:44 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:13:44 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:13:44 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:13:44 user nova-compute[71516]:   </os>
Apr 11 23:13:44 user nova-compute[71516]:   <features>
Apr 11 23:13:44 user nova-compute[71516]:     <acpi/>
Apr 11 23:13:44 user nova-compute[71516]:     <apic/>
Apr 11 23:13:44 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:13:44 user nova-compute[71516]:   </features>
Apr 11 23:13:44 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:13:44 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:13:44 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:13:44 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:13:44 user nova-compute[71516]:   </clock>
Apr 11 23:13:44 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:13:44 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:13:44 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:13:44 user nova-compute[71516]:   </cpu>
Apr 11 23:13:44 user nova-compute[71516]:   <devices>
Apr 11 23:13:44 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:13:44 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:13:44 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk"/>
Apr 11 23:13:44 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:13:44 user nova-compute[71516]:     </disk>
Apr 11 23:13:44 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:13:44 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:13:44 user nova-compute[71516]:       <source dev="/dev/sdb"/>
Apr 11 23:13:44 user nova-compute[71516]:       <target dev="vdb" bus="virtio"/>
Apr 11 23:13:44 user nova-compute[71516]:       <serial>acc3f3e9-087d-4fc0-a462-78564949fef5</serial>
Apr 11 23:13:44 user nova-compute[71516]:     </disk>
Apr 11 23:13:44 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:13:44 user nova-compute[71516]:       <mac address="fa:16:3e:ec:10:5e"/>
Apr 11 23:13:44 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:13:44 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:13:44 user nova-compute[71516]:       <target dev="tap961d8195-c0"/>
Apr 11 23:13:44 user nova-compute[71516]:     </interface>
Apr 11 23:13:44 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:13:44 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/console.log" append="off"/>
Apr 11 23:13:44 user nova-compute[71516]:     </serial>
Apr 11 23:13:44 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:13:44 user nova-compute[71516]:     <video>
Apr 11 23:13:44 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:13:44 user nova-compute[71516]:     </video>
Apr 11 23:13:44 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:13:44 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:13:44 user nova-compute[71516]:     </rng>
Apr 11 23:13:44 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:13:44 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:13:44 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:13:44 user nova-compute[71516]:     </memballoon>
Apr 11 23:13:44 user nova-compute[71516]:   </devices>
Apr 11 23:13:44 user nova-compute[71516]: </domain>
Apr 11 23:13:44 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1831107086',display_name='tempest-ServerActionsTestJSON-server-1247380178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1831107086',id=2,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-pn29cvap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=eed8cea5-9e5c-4467-8993-456cb3235fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:ec:10:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:ec:10:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG os_vif [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap961d8195-c0, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap961d8195-c0, col_values=(('external_ids', {'iface-id': '961d8195-c0d7-49eb-bfd7-05ee4b3e6112', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:10:5e', 'vm-uuid': 'eed8cea5-9e5c-4467-8993-456cb3235fd8'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:44 user nova-compute[71516]: INFO os_vif [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0')
Apr 11 23:13:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:13:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No VIF found with MAC fa:16:3e:ec:10:5e, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:13:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:45 user nova-compute[71516]: DEBUG nova.compute.manager [req-e6152b76-c528-4a39-9e8b-d61344c6d275 req-018f3009-01e5-4165-9023-1295bead8659 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e6152b76-c528-4a39-9e8b-d61344c6d275 req-018f3009-01e5-4165-9023-1295bead8659 service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e6152b76-c528-4a39-9e8b-d61344c6d275 req-018f3009-01e5-4165-9023-1295bead8659 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e6152b76-c528-4a39-9e8b-d61344c6d275 req-018f3009-01e5-4165-9023-1295bead8659 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:45 user nova-compute[71516]: DEBUG nova.compute.manager [req-e6152b76-c528-4a39-9e8b-d61344c6d275 req-018f3009-01e5-4165-9023-1295bead8659 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:45 user nova-compute[71516]: WARNING nova.compute.manager [req-e6152b76-c528-4a39-9e8b-d61344c6d275 req-018f3009-01e5-4165-9023-1295bead8659 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state active and task_state resize_finish.
Apr 11 23:13:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for eed8cea5-9e5c-4467-8993-456cb3235fd8 due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:13:47 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254827.8335478, eed8cea5-9e5c-4467-8993-456cb3235fd8 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:13:47 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] VM Resumed (Lifecycle Event)
Apr 11 23:13:47 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:13:47 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance running successfully.
Apr 11 23:13:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Failed to set time: agent not configured {{(pid=71516) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 23:13:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] finish_migration finished successfully. {{(pid=71516) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 23:13:47 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:47 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:13:47 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 23:13:47 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254827.838774, eed8cea5-9e5c-4467-8993-456cb3235fd8 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:13:47 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] VM Started (Lifecycle Event)
Apr 11 23:13:47 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:47 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:13:47 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 23:13:47 user nova-compute[71516]: DEBUG nova.compute.manager [req-23d0690c-9392-4de0-9f04-75849583d095 req-ac8cf75c-328d-4aa7-90a8-3a4b366ac9ec service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-23d0690c-9392-4de0-9f04-75849583d095 req-ac8cf75c-328d-4aa7-90a8-3a4b366ac9ec service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-23d0690c-9392-4de0-9f04-75849583d095 req-ac8cf75c-328d-4aa7-90a8-3a4b366ac9ec service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-23d0690c-9392-4de0-9f04-75849583d095 req-ac8cf75c-328d-4aa7-90a8-3a4b366ac9ec service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG nova.compute.manager [req-23d0690c-9392-4de0-9f04-75849583d095 req-ac8cf75c-328d-4aa7-90a8-3a4b366ac9ec service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:48 user nova-compute[71516]: WARNING nova.compute.manager [req-23d0690c-9392-4de0-9f04-75849583d095 req-ac8cf75c-328d-4aa7-90a8-3a4b366ac9ec service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state active and task_state resize_finish.
Apr 11 23:13:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "29cf3139-d486-40da-8ab9-e695e5fd539b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:13:48 user nova-compute[71516]: INFO nova.compute.claims [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Claim successful on node user
Apr 11 23:13:48 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:13:48 user nova-compute[71516]: DEBUG nova.network.neutron [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:13:48 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:13:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:13:49 user nova-compute[71516]: INFO nova.virt.block_device [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Booting with volume 6170821e-16c7-4cae-a138-dbac84aea6cd at /dev/vda
Apr 11 23:13:49 user nova-compute[71516]: DEBUG nova.policy [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG os_brick.utils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6290c9-0752-4687-b43a-7fb37277f34e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4fa450-4765-4df4-a49f-8132c0b31521]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[20744b55-97e1-4096-a281-65a1db7a22b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d697ad25-1582-476a-9cab-e5faecfed846]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:13:49 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:13:49 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b510d48-3aa0-49d7-b852-daae08244250]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG os_brick.utils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Updating existing volume attachment record: 979cf349-0b8f-4ee7-bf9d-ddbf311bd536 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:49 user nova-compute[71516]: DEBUG nova.network.neutron [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Successfully created port: d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:13:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:50 user nova-compute[71516]: DEBUG nova.network.neutron [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Successfully updated port: d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:13:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "refresh_cache-29cf3139-d486-40da-8ab9-e695e5fd539b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:13:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquired lock "refresh_cache-29cf3139-d486-40da-8ab9-e695e5fd539b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:13:50 user nova-compute[71516]: DEBUG nova.network.neutron [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:13:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Received event network-changed-d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Refreshing instance network info cache due to event network-changed-d7aa2bb2-d610-4a03-b5fc-be956243a668. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:13:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] Acquiring lock "refresh_cache-29cf3139-d486-40da-8ab9-e695e5fd539b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:13:51 user nova-compute[71516]: DEBUG nova.network.neutron [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:13:51 user nova-compute[71516]: DEBUG nova.network.neutron [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Updating instance_info_cache with network_info: [{"id": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "address": "fa:16:3e:1c:33:92", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aa2bb2-d6", "ovs_interfaceid": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:13:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Releasing lock "refresh_cache-29cf3139-d486-40da-8ab9-e695e5fd539b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:13:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Instance network_info: |[{"id": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "address": "fa:16:3e:1c:33:92", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aa2bb2-d6", "ovs_interfaceid": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:13:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] Acquired lock "refresh_cache-29cf3139-d486-40da-8ab9-e695e5fd539b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:13:51 user nova-compute[71516]: DEBUG nova.network.neutron [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Refreshing network info cache for port d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:13:51 user nova-compute[71516]: DEBUG nova.network.neutron [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Updated VIF entry in instance network info cache for port d7aa2bb2-d610-4a03-b5fc-be956243a668. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:13:51 user nova-compute[71516]: DEBUG nova.network.neutron [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Updating instance_info_cache with network_info: [{"id": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "address": "fa:16:3e:1c:33:92", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aa2bb2-d6", "ovs_interfaceid": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:13:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] Releasing lock "refresh_cache-29cf3139-d486-40da-8ab9-e695e5fd539b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:13:53 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Creating image(s)
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Ensure instance console log exists: /opt/stack/data/nova/instances/29cf3139-d486-40da-8ab9-e695e5fd539b/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Start _get_guest_xml network_info=[{"id": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "address": "fa:16:3e:1c:33:92", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aa2bb2-d6", "ovs_interfaceid": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaBHCpOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '29cf3139-d486-40da-8ab9-e695e5fd539b', 'attached_at': '', 'detached_at': '', 'volume_id': '6170821e-16c7-4cae-a138-dbac84aea6cd', 'serial': '6170821e-16c7-4cae-a138-dbac84aea6cd'}, 'disk_bus': 'virtio', 'attachment_id': '979cf349-0b8f-4ee7-bf9d-ddbf311bd536', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:13:53 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:13:53 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaBHCpOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:13:53 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:13:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:13:53 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:13:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:13:53 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:13:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[34812f56-17c4-40ee-8a1e-5494d8bea599]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:13:53 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca81879-036a-4f2a-97b8-bf45e9770a3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd] added
Apr 11 23:13:53 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aca9f88-f002-45f8-abaf-8b45e4f143ec]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83ae01e-07cd-46ee-b017-b372d8b67825]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DaBHCpOu {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DaBHCpOu" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[386eb34a-2134-474a-b61b-afe55139e662]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DaBHCpOu'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9485003f-f3ed-4e6e-a6ca-6516e9ff4dc8]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[102368a1-abb5-4a1f-bb21-437c05a887f7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:54 user nova-compute[71516]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:13:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:54 user nova-compute[71516]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:13:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01be544-5c40-4337-a88e-19ce4869cff9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260]
Apr 11 23:13:54 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260] successful.
Apr 11 23:13:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[990490a0-dcff-4225-97d1-32d5ae0bc957]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1756f1-d678-4f69-a2b5-d3f6adbbe358]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:54 user nova-compute[71516]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:13:54 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:13:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:13:54 user nova-compute[71516]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:13:54 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:13:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[de132c3f-9faa-4567-899a-868e9fd94739]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: None {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:13:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaBHCpOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26634393662616436', 'path': '/dev/sdd'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634393662616436', 'path': '/dev/sdd'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-645887436',display_name='tempest-TestVolumeBootPattern-server-645887436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-645887436',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTeA7e6j/wrChwM1jogClH0JWZ33jOggStHh7lL1aQsrNXULlUHFl3iqjE9etghhRnMsyLyd4JqIILvNvoCcqVmiQ5foShdj8Q9wa2sI4sRIJCvJ4hRZ+cCGZXsMJkWw==',key_name='tempest-TestVolumeBootPattern-15540354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-skg080bp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:13:49Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=29cf3139-d486-40da-8ab9-e695e5fd539b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "address": "fa:16:3e:1c:33:92", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aa2bb2-d6", "ovs_interfaceid": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "address": "fa:16:3e:1c:33:92", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aa2bb2-d6", "ovs_interfaceid": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:33:92,bridge_name='br-int',has_traffic_filtering=True,id=d7aa2bb2-d610-4a03-b5fc-be956243a668,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7aa2bb2-d6') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG nova.objects.instance [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lazy-loading 'pci_devices' on Instance uuid 29cf3139-d486-40da-8ab9-e695e5fd539b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:13:55 user nova-compute[71516]:   <uuid>29cf3139-d486-40da-8ab9-e695e5fd539b</uuid>
Apr 11 23:13:55 user nova-compute[71516]:   <name>instance-0000001a</name>
Apr 11 23:13:55 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:13:55 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:13:55 user nova-compute[71516]:   <metadata>
Apr 11 23:13:55 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:13:55 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:13:55 user nova-compute[71516]:       <nova:name>tempest-TestVolumeBootPattern-server-645887436</nova:name>
Apr 11 23:13:55 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:13:53</nova:creationTime>
Apr 11 23:13:55 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:13:55 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:13:55 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:13:55 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:13:55 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:13:55 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:13:55 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:13:55 user nova-compute[71516]:       <nova:owner>
Apr 11 23:13:55 user nova-compute[71516]:         <nova:user uuid="589c07cd12e849cfa38423959e76c695">tempest-TestVolumeBootPattern-365588456-project-member</nova:user>
Apr 11 23:13:55 user nova-compute[71516]:         <nova:project uuid="f6700d66136e4f9590658e3103cceac8">tempest-TestVolumeBootPattern-365588456</nova:project>
Apr 11 23:13:55 user nova-compute[71516]:       </nova:owner>
Apr 11 23:13:55 user nova-compute[71516]:       <nova:ports>
Apr 11 23:13:55 user nova-compute[71516]:         <nova:port uuid="d7aa2bb2-d610-4a03-b5fc-be956243a668">
Apr 11 23:13:55 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:13:55 user nova-compute[71516]:         </nova:port>
Apr 11 23:13:55 user nova-compute[71516]:       </nova:ports>
Apr 11 23:13:55 user nova-compute[71516]:     </nova:instance>
Apr 11 23:13:55 user nova-compute[71516]:   </metadata>
Apr 11 23:13:55 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:13:55 user nova-compute[71516]:     <system>
Apr 11 23:13:55 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:13:55 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:13:55 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:13:55 user nova-compute[71516]:       <entry name="serial">29cf3139-d486-40da-8ab9-e695e5fd539b</entry>
Apr 11 23:13:55 user nova-compute[71516]:       <entry name="uuid">29cf3139-d486-40da-8ab9-e695e5fd539b</entry>
Apr 11 23:13:55 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:13:55 user nova-compute[71516]:     </system>
Apr 11 23:13:55 user nova-compute[71516]:   </sysinfo>
Apr 11 23:13:55 user nova-compute[71516]:   <os>
Apr 11 23:13:55 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:13:55 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:13:55 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:13:55 user nova-compute[71516]:   </os>
Apr 11 23:13:55 user nova-compute[71516]:   <features>
Apr 11 23:13:55 user nova-compute[71516]:     <acpi/>
Apr 11 23:13:55 user nova-compute[71516]:     <apic/>
Apr 11 23:13:55 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:13:55 user nova-compute[71516]:   </features>
Apr 11 23:13:55 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:13:55 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:13:55 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:13:55 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:13:55 user nova-compute[71516]:   </clock>
Apr 11 23:13:55 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:13:55 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:13:55 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:13:55 user nova-compute[71516]:   </cpu>
Apr 11 23:13:55 user nova-compute[71516]:   <devices>
Apr 11 23:13:55 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:13:55 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:13:55 user nova-compute[71516]:       <source dev="/dev/sdd"/>
Apr 11 23:13:55 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:13:55 user nova-compute[71516]:       <serial>6170821e-16c7-4cae-a138-dbac84aea6cd</serial>
Apr 11 23:13:55 user nova-compute[71516]:     </disk>
Apr 11 23:13:55 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:13:55 user nova-compute[71516]:       <mac address="fa:16:3e:1c:33:92"/>
Apr 11 23:13:55 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:13:55 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:13:55 user nova-compute[71516]:       <target dev="tapd7aa2bb2-d6"/>
Apr 11 23:13:55 user nova-compute[71516]:     </interface>
Apr 11 23:13:55 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:13:55 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/29cf3139-d486-40da-8ab9-e695e5fd539b/console.log" append="off"/>
Apr 11 23:13:55 user nova-compute[71516]:     </serial>
Apr 11 23:13:55 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:13:55 user nova-compute[71516]:     <video>
Apr 11 23:13:55 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:13:55 user nova-compute[71516]:     </video>
Apr 11 23:13:55 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:13:55 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:13:55 user nova-compute[71516]:     </rng>
Apr 11 23:13:55 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:13:55 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:13:55 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:13:55 user nova-compute[71516]:     </memballoon>
Apr 11 23:13:55 user nova-compute[71516]:   </devices>
Apr 11 23:13:55 user nova-compute[71516]: </domain>
Apr 11 23:13:55 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-645887436',display_name='tempest-TestVolumeBootPattern-server-645887436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-645887436',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTeA7e6j/wrChwM1jogClH0JWZ33jOggStHh7lL1aQsrNXULlUHFl3iqjE9etghhRnMsyLyd4JqIILvNvoCcqVmiQ5foShdj8Q9wa2sI4sRIJCvJ4hRZ+cCGZXsMJkWw==',key_name='tempest-TestVolumeBootPattern-15540354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-skg080bp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:13:49Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=29cf3139-d486-40da-8ab9-e695e5fd539b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "address": "fa:16:3e:1c:33:92", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aa2bb2-d6", "ovs_interfaceid": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "address": "fa:16:3e:1c:33:92", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aa2bb2-d6", "ovs_interfaceid": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:33:92,bridge_name='br-int',has_traffic_filtering=True,id=d7aa2bb2-d610-4a03-b5fc-be956243a668,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7aa2bb2-d6') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG os_vif [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:33:92,bridge_name='br-int',has_traffic_filtering=True,id=d7aa2bb2-d610-4a03-b5fc-be956243a668,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7aa2bb2-d6') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7aa2bb2-d6, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7aa2bb2-d6, col_values=(('external_ids', {'iface-id': 'd7aa2bb2-d610-4a03-b5fc-be956243a668', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:33:92', 'vm-uuid': '29cf3139-d486-40da-8ab9-e695e5fd539b'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:55 user nova-compute[71516]: INFO os_vif [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:33:92,bridge_name='br-int',has_traffic_filtering=True,id=d7aa2bb2-d610-4a03-b5fc-be956243a668,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7aa2bb2-d6')
Apr 11 23:13:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] No VIF found with MAC fa:16:3e:1c:33:92, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:13:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-869a9307-e085-473f-bb07-743087fa497d req-a7c5d01d-563f-4f82-86ac-68d3ba2a7aa5 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Received event network-vif-plugged-d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-869a9307-e085-473f-bb07-743087fa497d req-a7c5d01d-563f-4f82-86ac-68d3ba2a7aa5 service nova] Acquiring lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-869a9307-e085-473f-bb07-743087fa497d req-a7c5d01d-563f-4f82-86ac-68d3ba2a7aa5 service nova] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-869a9307-e085-473f-bb07-743087fa497d req-a7c5d01d-563f-4f82-86ac-68d3ba2a7aa5 service nova] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-869a9307-e085-473f-bb07-743087fa497d req-a7c5d01d-563f-4f82-86ac-68d3ba2a7aa5 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] No waiting events found dispatching network-vif-plugged-d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:56 user nova-compute[71516]: WARNING nova.compute.manager [req-869a9307-e085-473f-bb07-743087fa497d req-a7c5d01d-563f-4f82-86ac-68d3ba2a7aa5 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Received unexpected event network-vif-plugged-d7aa2bb2-d610-4a03-b5fc-be956243a668 for instance with vm_state building and task_state spawning.
Apr 11 23:13:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-1c95a270-f7dc-435b-bab1-f6f4cc902fd4 req-8411ef24-bd88-4818-b801-79d2032ff2cc service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Received event network-vif-plugged-d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1c95a270-f7dc-435b-bab1-f6f4cc902fd4 req-8411ef24-bd88-4818-b801-79d2032ff2cc service nova] Acquiring lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1c95a270-f7dc-435b-bab1-f6f4cc902fd4 req-8411ef24-bd88-4818-b801-79d2032ff2cc service nova] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1c95a270-f7dc-435b-bab1-f6f4cc902fd4 req-8411ef24-bd88-4818-b801-79d2032ff2cc service nova] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-1c95a270-f7dc-435b-bab1-f6f4cc902fd4 req-8411ef24-bd88-4818-b801-79d2032ff2cc service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] No waiting events found dispatching network-vif-plugged-d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:13:58 user nova-compute[71516]: WARNING nova.compute.manager [req-1c95a270-f7dc-435b-bab1-f6f4cc902fd4 req-8411ef24-bd88-4818-b801-79d2032ff2cc service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Received unexpected event network-vif-plugged-d7aa2bb2-d610-4a03-b5fc-be956243a668 for instance with vm_state building and task_state spawning.
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254838.9379892, 29cf3139-d486-40da-8ab9-e695e5fd539b => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:13:58 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] VM Resumed (Lifecycle Event)
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:13:58 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Instance spawned successfully.
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:13:58 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:13:58 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254838.9389422, 29cf3139-d486-40da-8ab9-e695e5fd539b => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:13:58 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] VM Started (Lifecycle Event)
Apr 11 23:13:59 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:59 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:13:59 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:13:59 user nova-compute[71516]: INFO nova.compute.manager [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Took 5.24 seconds to spawn the instance on the hypervisor.
Apr 11 23:13:59 user nova-compute[71516]: DEBUG nova.compute.manager [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:13:59 user nova-compute[71516]: INFO nova.compute.manager [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Took 10.77 seconds to build instance.
Apr 11 23:13:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.858s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-changed-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Refreshing instance network info cache due to event network-changed-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:14:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] Acquiring lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:14:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] Acquired lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:14:05 user nova-compute[71516]: DEBUG nova.network.neutron [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Refreshing network info cache for port 5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:14:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:05 user nova-compute[71516]: DEBUG nova.network.neutron [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Updated VIF entry in instance network info cache for port 5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:14:05 user nova-compute[71516]: DEBUG nova.network.neutron [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Updating instance_info_cache with network_info: [{"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:14:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] Releasing lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:14:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:07 user nova-compute[71516]: INFO nova.compute.manager [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Shelving
Apr 11 23:14:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-f6a57f4e-c447-4a2d-87c2-1194c1d79d62 req-9f85a48d-d10c-4d30-a307-496196877a1a service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-vif-unplugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f6a57f4e-c447-4a2d-87c2-1194c1d79d62 req-9f85a48d-d10c-4d30-a307-496196877a1a service nova] Acquiring lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f6a57f4e-c447-4a2d-87c2-1194c1d79d62 req-9f85a48d-d10c-4d30-a307-496196877a1a service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f6a57f4e-c447-4a2d-87c2-1194c1d79d62 req-9f85a48d-d10c-4d30-a307-496196877a1a service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-f6a57f4e-c447-4a2d-87c2-1194c1d79d62 req-9f85a48d-d10c-4d30-a307-496196877a1a service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] No waiting events found dispatching network-vif-unplugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:14:08 user nova-compute[71516]: WARNING nova.compute.manager [req-f6a57f4e-c447-4a2d-87c2-1194c1d79d62 req-9f85a48d-d10c-4d30-a307-496196877a1a service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received unexpected event network-vif-unplugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance with vm_state active and task_state shelving.
Apr 11 23:14:08 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Instance destroyed successfully.
Apr 11 23:14:08 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Beginning cold snapshot process
Apr 11 23:14:08 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:14:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk /opt/stack/data/nova/instances/snapshots/tmpy6kyjiq4/ccfe4cee04ef429dae123410ed0cfaee {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk /opt/stack/data/nova/instances/snapshots/tmpy6kyjiq4/ccfe4cee04ef429dae123410ed0cfaee" returned: 0 in 0.368s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:09 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Snapshot extracted, beginning image upload
Apr 11 23:14:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-570e98a5-a4ec-4309-824f-4a977f2d0336 req-75e172fc-bf41-4844-9a00-3aac092549cf service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-570e98a5-a4ec-4309-824f-4a977f2d0336 req-75e172fc-bf41-4844-9a00-3aac092549cf service nova] Acquiring lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-570e98a5-a4ec-4309-824f-4a977f2d0336 req-75e172fc-bf41-4844-9a00-3aac092549cf service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-570e98a5-a4ec-4309-824f-4a977f2d0336 req-75e172fc-bf41-4844-9a00-3aac092549cf service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-570e98a5-a4ec-4309-824f-4a977f2d0336 req-75e172fc-bf41-4844-9a00-3aac092549cf service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] No waiting events found dispatching network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:14:10 user nova-compute[71516]: WARNING nova.compute.manager [req-570e98a5-a4ec-4309-824f-4a977f2d0336 req-75e172fc-bf41-4844-9a00-3aac092549cf service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received unexpected event network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 23:14:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:11 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Snapshot image upload complete
Apr 11 23:14:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:14:11 user nova-compute[71516]: INFO nova.compute.manager [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Shelve offloading
Apr 11 23:14:11 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Instance destroyed successfully.
Apr 11 23:14:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:14:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:14:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquired lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:14:11 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:14:11 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Updating instance_info_cache with network_info: [{"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:14:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Releasing lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:14:12 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Instance destroyed successfully.
Apr 11 23:14:12 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'resources' on Instance uuid fab7f71b-57f6-415b-9d2d-262a8ec6cb03 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1536485804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1536485804',id=21,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWDui0SPuSNcW3iQQT+n8CdN0Nt1xzZAZfHsKqwSiujdTOOOEDSXAwM3wlZDgrq/pjBr0c+y+HW1Zg37Jw+CuC31UFynDxv2RaP8mEcuOy82rtfiD6ySkPqukQhekjgAg==',key_name='tempest-keypair-865048007',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b466a7e141a247319eae64ab30aca760',ramdisk_id='',reservation_id='r-05tlqmg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849897654',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849897654-project-member',shelved_at='2023-04-11T23:14:11.236038',shelved_host='user',shelved_image_id='33687ef1-a0b8-497f-ad63-b52558ba5afc'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:14:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7272af33be864737b2231127f4323638',uuid=fab7f71b-57f6-415b-9d2d-262a8ec6cb03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converting VIF {"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG os_vif [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f6c4dd1-5b, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG nova.compute.manager [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-changed-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG nova.compute.manager [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Refreshing instance network info cache due to event network-changed-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] Acquiring lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] Acquired lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG nova.network.neutron [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Refreshing network info cache for port 5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:14:12 user nova-compute[71516]: INFO os_vif [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b')
Apr 11 23:14:12 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Deleting instance files /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03_del
Apr 11 23:14:12 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Deletion of /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03_del complete
Apr 11 23:14:12 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Deleted allocations for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03
Apr 11 23:14:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'numa_topology' on Instance uuid fab7f71b-57f6-415b-9d2d-262a8ec6cb03 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG nova.network.neutron [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Updated VIF entry in instance network info cache for port 5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG nova.network.neutron [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Updating instance_info_cache with network_info: [{"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] Releasing lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:14:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.125s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:23 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254848.5360274, fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:14:23 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] VM Stopped (Lifecycle Event)
Apr 11 23:14:23 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9f1e0e48-1cf5-4798-9f88-6fe5ab510672 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f2a79a44-800e-4142-b778-aae06a5c779d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2a79a44-800e-4142-b778-aae06a5c779d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:24 user nova-compute[71516]: INFO nova.compute.manager [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Terminating instance
Apr 11 23:14:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-387d3a9f-1dc2-4b39-a029-fb719cd272da req-1a16913a-9e3b-4d0f-8fa6-029c473d24b2 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Received event network-vif-unplugged-970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-387d3a9f-1dc2-4b39-a029-fb719cd272da req-1a16913a-9e3b-4d0f-8fa6-029c473d24b2 service nova] Acquiring lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-387d3a9f-1dc2-4b39-a029-fb719cd272da req-1a16913a-9e3b-4d0f-8fa6-029c473d24b2 service nova] Lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-387d3a9f-1dc2-4b39-a029-fb719cd272da req-1a16913a-9e3b-4d0f-8fa6-029c473d24b2 service nova] Lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-387d3a9f-1dc2-4b39-a029-fb719cd272da req-1a16913a-9e3b-4d0f-8fa6-029c473d24b2 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] No waiting events found dispatching network-vif-unplugged-970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-387d3a9f-1dc2-4b39-a029-fb719cd272da req-1a16913a-9e3b-4d0f-8fa6-029c473d24b2 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Received event network-vif-unplugged-970d841b-bbfc-409e-8ec5-ddbea8be8c5d for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:14:24 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Instance destroyed successfully.
Apr 11 23:14:24 user nova-compute[71516]: DEBUG nova.objects.instance [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'resources' on Instance uuid f2a79a44-800e-4142-b778-aae06a5c779d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-294909853',display_name='tempest-AttachVolumeNegativeTest-server-294909853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-294909853',id=15,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0zqkr5JslO5pazVYnbydw15T9EjvLg2GhWoOpKqa/Wjsgfn0KXK0Lu5zOBrtqyynlBKK+TPkpstQuZbuDS46amji1YuAoDEopw7Gf9EJdnvh6SOK92JvEf778W3uX0Dg==',key_name='tempest-keypair-1101679830',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f29d28c472c4f65b8437ce443d208c7',ramdisk_id='',reservation_id='r-dfiig29j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2123485934',owner_user_name='tempest-AttachVolumeNegativeTest-2123485934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:09:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da1389f3e27f49f394598636d041a9c9',uuid=f2a79a44-800e-4142-b778-aae06a5c779d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "address": "fa:16:3e:16:12:b6", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970d841b-bb", "ovs_interfaceid": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converting VIF {"id": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "address": "fa:16:3e:16:12:b6", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970d841b-bb", "ovs_interfaceid": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:12:b6,bridge_name='br-int',has_traffic_filtering=True,id=970d841b-bbfc-409e-8ec5-ddbea8be8c5d,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970d841b-bb') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG os_vif [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:12:b6,bridge_name='br-int',has_traffic_filtering=True,id=970d841b-bbfc-409e-8ec5-ddbea8be8c5d,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970d841b-bb') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap970d841b-bb, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:24 user nova-compute[71516]: INFO os_vif [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:12:b6,bridge_name='br-int',has_traffic_filtering=True,id=970d841b-bbfc-409e-8ec5-ddbea8be8c5d,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970d841b-bb')
Apr 11 23:14:24 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Deleting instance files /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d_del
Apr 11 23:14:24 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Deletion of /opt/stack/data/nova/instances/f2a79a44-800e-4142-b778-aae06a5c779d_del complete
Apr 11 23:14:24 user nova-compute[71516]: INFO nova.compute.manager [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 23:14:24 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:14:24 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:14:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:26 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:14:26 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Took 1.12 seconds to deallocate network for instance.
Apr 11 23:14:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-bb7b8c2c-3610-4f41-87da-b3558f75f7ad req-897e34db-41d7-45ff-bc0f-1ffb8d21d370 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Received event network-vif-deleted-970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:26 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:14:26 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:14:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-6e3fdb42-8609-4bed-a9b0-c83e4558c580 req-ced2fbe4-b561-44d7-8f51-6d8f279a9300 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Received event network-vif-plugged-970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6e3fdb42-8609-4bed-a9b0-c83e4558c580 req-ced2fbe4-b561-44d7-8f51-6d8f279a9300 service nova] Acquiring lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6e3fdb42-8609-4bed-a9b0-c83e4558c580 req-ced2fbe4-b561-44d7-8f51-6d8f279a9300 service nova] Lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6e3fdb42-8609-4bed-a9b0-c83e4558c580 req-ced2fbe4-b561-44d7-8f51-6d8f279a9300 service nova] Lock "f2a79a44-800e-4142-b778-aae06a5c779d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-6e3fdb42-8609-4bed-a9b0-c83e4558c580 req-ced2fbe4-b561-44d7-8f51-6d8f279a9300 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] No waiting events found dispatching network-vif-plugged-970d841b-bbfc-409e-8ec5-ddbea8be8c5d {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:14:26 user nova-compute[71516]: WARNING nova.compute.manager [req-6e3fdb42-8609-4bed-a9b0-c83e4558c580 req-ced2fbe4-b561-44d7-8f51-6d8f279a9300 service nova] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Received unexpected event network-vif-plugged-970d841b-bbfc-409e-8ec5-ddbea8be8c5d for instance with vm_state deleted and task_state None.
Apr 11 23:14:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:26 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Deleted allocations for instance f2a79a44-800e-4142-b778-aae06a5c779d
Apr 11 23:14:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f2a79a44-800e-4142-b778-aae06a5c779d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.444s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:27 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Updating instance_info_cache with network_info: [{"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:14:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:14:31 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:14:31 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=7806MB free_disk=26.302276611328125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Applying migration context for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 as it has an incoming, in-progress migration 42989b85-5137-41a1-a2f6-d2c7aae7cf5e. Migration status is finished {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 23:14:31 user nova-compute[71516]: INFO nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating resource usage from migration 42989b85-5137-41a1-a2f6-d2c7aae7cf5e
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e4d31874-4273-48bc-8811-89832d18b893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 410941af-9184-44ae-b416-b2a265c24f02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Migration 42989b85-5137-41a1-a2f6-d2c7aae7cf5e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 29cf3139-d486-40da-8ab9-e695e5fd539b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:14:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:32 user nova-compute[71516]: INFO nova.compute.manager [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Detaching volume 75f7d204-26d3-4992-8036-0690d066ab68
Apr 11 23:14:32 user nova-compute[71516]: INFO nova.virt.block_device [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Attempting to driver detach volume 75f7d204-26d3-4992-8036-0690d066ab68 from mountpoint /dev/vdb
Apr 11 23:14:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Attempting to detach device vdb from instance e4d31874-4273-48bc-8811-89832d18b893 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:14:32 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:14:32 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:14:32 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:14:32 user nova-compute[71516]:   <serial>75f7d204-26d3-4992-8036-0690d066ab68</serial>
Apr 11 23:14:32 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 23:14:32 user nova-compute[71516]: </disk>
Apr 11 23:14:32 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:14:32 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully detached device vdb from instance e4d31874-4273-48bc-8811-89832d18b893 from the persistent domain config.
Apr 11 23:14:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4d31874-4273-48bc-8811-89832d18b893 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:14:32 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:14:32 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:14:32 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:14:32 user nova-compute[71516]:   <serial>75f7d204-26d3-4992-8036-0690d066ab68</serial>
Apr 11 23:14:32 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 23:14:32 user nova-compute[71516]: </disk>
Apr 11 23:14:32 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681254872.839876, e4d31874-4273-48bc-8811-89832d18b893 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:14:32 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully detached device vdb from instance e4d31874-4273-48bc-8811-89832d18b893 from the live domain config.
Apr 11 23:14:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etIkblUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:14:32 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:14:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d91d858-8dda-4ff0-b158-0b6cbcc9993b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:14:32 user nova-compute[71516]: No targets found.
Apr 11 23:14:32 user nova-compute[71516]: iSNS:
Apr 11 23:14:32 user nova-compute[71516]: No targets found.
Apr 11 23:14:32 user nova-compute[71516]: STATIC:
Apr 11 23:14:32 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5
Apr 11 23:14:32 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:14:32 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:14:32 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68
Apr 11 23:14:32 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:14:32 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:14:32 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd
Apr 11 23:14:32 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:14:32 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:14:32 user nova-compute[71516]: FIRMWARE:
Apr 11 23:14:32 user nova-compute[71516]: No targets found.
Apr 11 23:14:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:14:32 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:14:32 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff94c3b-4834-4f1b-8acc-7df924ea982a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb23b6e-b594-4c9f-80cb-2b30c6599131]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:14:32 user nova-compute[71516]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:14:32 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:14:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 (non-flash)
Apr 11 23:14:32 user nova-compute[71516]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:14:32 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:14:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5fda3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[022f9488-4eae-4112-8d56-5b8462c9a599]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12c35c5-c3d1-4a0d-a90d-881107364c5d]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19190c6-8ca4-46ad-a334-41e86a756920]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:14:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6732da8c-b760-4294-b12f-fdda81539873]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cd8e57-8569-4523-9c2f-ad6b4a4a2e36]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dd180b-48c4-465b-b23f-ce381fb4669d]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260]
Apr 11 23:14:33 user nova-compute[71516]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68, portal: 172.16.0.220,3260] successful.
Apr 11 23:14:33 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f7d204-26d3-4992-8036-0690d066ab68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[78723b91-0879-43ef-a709-9c5dd556bef1]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] <== disconnect_volume: return (296ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG nova.objects.instance [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'flavor' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:14:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.696s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-813c37f8-bd6a-4e1b-b493-45545f08bc93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-813c37f8-bd6a-4e1b-b493-45545f08bc93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-813c37f8-bd6a-4e1b-b493-45545f08bc93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-813c37f8-bd6a-4e1b-b493-45545f08bc93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71516) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG nova.objects.instance [None req-813c37f8-bd6a-4e1b-b493-45545f08bc93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'flavor' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG nova.compute.manager [req-c1f719b0-6278-49b5-a7d1-ee15f156fe5c req-b67ff609-56fe-4e10-9cf9-7bbefe4e0f75 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-unplugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c1f719b0-6278-49b5-a7d1-ee15f156fe5c req-b67ff609-56fe-4e10-9cf9-7bbefe4e0f75 service nova] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c1f719b0-6278-49b5-a7d1-ee15f156fe5c req-b67ff609-56fe-4e10-9cf9-7bbefe4e0f75 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c1f719b0-6278-49b5-a7d1-ee15f156fe5c req-b67ff609-56fe-4e10-9cf9-7bbefe4e0f75 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:34 user nova-compute[71516]: DEBUG nova.compute.manager [req-c1f719b0-6278-49b5-a7d1-ee15f156fe5c req-b67ff609-56fe-4e10-9cf9-7bbefe4e0f75 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] No waiting events found dispatching network-vif-unplugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:14:34 user nova-compute[71516]: WARNING nova.compute.manager [req-c1f719b0-6278-49b5-a7d1-ee15f156fe5c req-b67ff609-56fe-4e10-9cf9-7bbefe4e0f75 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received unexpected event network-vif-unplugged-ac90e400-803b-41b5-b183-f93bfbf297b6 for instance with vm_state active and task_state powering-off.
Apr 11 23:14:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:35 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:14:35 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:14:35 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:14:35 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:14:35 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:14:35 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:14:35 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:14:35 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] Instance destroyed successfully.
Apr 11 23:14:35 user nova-compute[71516]: DEBUG nova.compute.manager [None req-813c37f8-bd6a-4e1b-b493-45545f08bc93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:14:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-813c37f8-bd6a-4e1b-b493-45545f08bc93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.843s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed55f118-438a-4ef5-83f5-d82ac167ece5 req-82e3e4d7-d59b-4016-8af8-b19fc359dac7 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed55f118-438a-4ef5-83f5-d82ac167ece5 req-82e3e4d7-d59b-4016-8af8-b19fc359dac7 service nova] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed55f118-438a-4ef5-83f5-d82ac167ece5 req-82e3e4d7-d59b-4016-8af8-b19fc359dac7 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed55f118-438a-4ef5-83f5-d82ac167ece5 req-82e3e4d7-d59b-4016-8af8-b19fc359dac7 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed55f118-438a-4ef5-83f5-d82ac167ece5 req-82e3e4d7-d59b-4016-8af8-b19fc359dac7 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] No waiting events found dispatching network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:14:36 user nova-compute[71516]: WARNING nova.compute.manager [req-ed55f118-438a-4ef5-83f5-d82ac167ece5 req-82e3e4d7-d59b-4016-8af8-b19fc359dac7 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received unexpected event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 for instance with vm_state stopped and task_state None.
Apr 11 23:14:39 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254864.8117654, f2a79a44-800e-4142-b778-aae06a5c779d => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:14:39 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] VM Stopped (Lifecycle Event)
Apr 11 23:14:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-f99cc6ee-e6dc-4cee-89c2-2523032007a3 None None] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:14:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:40 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:14:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:42 user nova-compute[71516]: INFO nova.compute.manager [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Terminating instance
Apr 11 23:14:42 user nova-compute[71516]: DEBUG nova.compute.manager [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-4d23b4aa-ac13-4f10-94c1-5d74e4a5ee39 req-fcceb35a-1877-4715-9255-bdeaa60933a5 service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Received event network-vif-unplugged-a88122ee-01e7-411d-9ce2-2e8265b5aba5 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4d23b4aa-ac13-4f10-94c1-5d74e4a5ee39 req-fcceb35a-1877-4715-9255-bdeaa60933a5 service nova] Acquiring lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4d23b4aa-ac13-4f10-94c1-5d74e4a5ee39 req-fcceb35a-1877-4715-9255-bdeaa60933a5 service nova] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4d23b4aa-ac13-4f10-94c1-5d74e4a5ee39 req-fcceb35a-1877-4715-9255-bdeaa60933a5 service nova] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-4d23b4aa-ac13-4f10-94c1-5d74e4a5ee39 req-fcceb35a-1877-4715-9255-bdeaa60933a5 service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] No waiting events found dispatching network-vif-unplugged-a88122ee-01e7-411d-9ce2-2e8265b5aba5 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:14:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-4d23b4aa-ac13-4f10-94c1-5d74e4a5ee39 req-fcceb35a-1877-4715-9255-bdeaa60933a5 service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Received event network-vif-unplugged-a88122ee-01e7-411d-9ce2-2e8265b5aba5 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:14:43 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Instance destroyed successfully.
Apr 11 23:14:43 user nova-compute[71516]: DEBUG nova.objects.instance [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lazy-loading 'resources' on Instance uuid f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1014668258',display_name='tempest-VolumesNegativeTest-instance-1014668258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1014668258',id=22,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:12:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8af76ed8ad9f4a429e346b6f8eedf895',ramdisk_id='',reservation_id='r-cxur1pii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2128115870',owner_user_name='tempest-VolumesNegativeTest-2128115870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:13:00Z,user_data=None,user_id='6b9ffaa1f08b42ca9af5ce17a283f51b',uuid=f1767c12-a304-4d8c-a8bf-06e2bfa3aa59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "address": "fa:16:3e:de:36:ca", "network": {"id": "fc38e5dd-2ad6-4241-ae95-66147fb8e61e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc4c5175ee99459396db72418ed47d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88122ee-01", "ovs_interfaceid": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Converting VIF {"id": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "address": "fa:16:3e:de:36:ca", "network": {"id": "fc38e5dd-2ad6-4241-ae95-66147fb8e61e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc4c5175ee99459396db72418ed47d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88122ee-01", "ovs_interfaceid": "a88122ee-01e7-411d-9ce2-2e8265b5aba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=a88122ee-01e7-411d-9ce2-2e8265b5aba5,network=Network(fc38e5dd-2ad6-4241-ae95-66147fb8e61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88122ee-01') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG os_vif [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=a88122ee-01e7-411d-9ce2-2e8265b5aba5,network=Network(fc38e5dd-2ad6-4241-ae95-66147fb8e61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88122ee-01') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa88122ee-01, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:43 user nova-compute[71516]: INFO os_vif [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:36:ca,bridge_name='br-int',has_traffic_filtering=True,id=a88122ee-01e7-411d-9ce2-2e8265b5aba5,network=Network(fc38e5dd-2ad6-4241-ae95-66147fb8e61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88122ee-01')
Apr 11 23:14:43 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Deleting instance files /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59_del
Apr 11 23:14:43 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Deletion of /opt/stack/data/nova/instances/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59_del complete
Apr 11 23:14:43 user nova-compute[71516]: INFO nova.compute.manager [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 11 23:14:43 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:14:43 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Took 0.47 seconds to deallocate network for instance.
Apr 11 23:14:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:14:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:44 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Deleted allocations for instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59
Apr 11 23:14:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.561s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Received event network-vif-plugged-a88122ee-01e7-411d-9ce2-2e8265b5aba5 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] Acquiring lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] Lock "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] No waiting events found dispatching network-vif-plugged-a88122ee-01e7-411d-9ce2-2e8265b5aba5 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:14:44 user nova-compute[71516]: WARNING nova.compute.manager [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Received unexpected event network-vif-plugged-a88122ee-01e7-411d-9ce2-2e8265b5aba5 for instance with vm_state deleted and task_state None.
Apr 11 23:14:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Received event network-vif-deleted-a88122ee-01e7-411d-9ce2-2e8265b5aba5 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:50 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254875.3385901, e4d31874-4273-48bc-8811-89832d18b893 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:14:50 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] VM Stopped (Lifecycle Event)
Apr 11 23:14:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0bd3386f-2a05-4f8b-b88c-4d2b7d07634a None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:14:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0bd3386f-2a05-4f8b-b88c-4d2b7d07634a None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:14:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:53 user nova-compute[71516]: INFO nova.compute.manager [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Rescuing
Apr 11 23:14:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:14:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquired lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:14:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:14:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Updating instance_info_cache with network_info: [{"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:14:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Releasing lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-d9ebcbc3-7f58-4748-9588-3f1f2b9d1ab8 req-4f94f110-246b-4885-949d-70467cdca188 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received event network-vif-unplugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d9ebcbc3-7f58-4748-9588-3f1f2b9d1ab8 req-4f94f110-246b-4885-949d-70467cdca188 service nova] Acquiring lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d9ebcbc3-7f58-4748-9588-3f1f2b9d1ab8 req-4f94f110-246b-4885-949d-70467cdca188 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d9ebcbc3-7f58-4748-9588-3f1f2b9d1ab8 req-4f94f110-246b-4885-949d-70467cdca188 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-d9ebcbc3-7f58-4748-9588-3f1f2b9d1ab8 req-4f94f110-246b-4885-949d-70467cdca188 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] No waiting events found dispatching network-vif-unplugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:14:54 user nova-compute[71516]: WARNING nova.compute.manager [req-d9ebcbc3-7f58-4748-9588-3f1f2b9d1ab8 req-4f94f110-246b-4885-949d-70467cdca188 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received unexpected event network-vif-unplugged-6eb4af06-413f-41c6-892b-f2d66653509f for instance with vm_state active and task_state rescuing.
Apr 11 23:14:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:54 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Instance destroyed successfully.
Apr 11 23:14:54 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Attempting rescue
Apr 11 23:14:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71516) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Instance directory exists: not creating {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 23:14:54 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Creating image(s)
Apr 11 23:14:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "/opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "/opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "/opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'trusted_certs' on Instance uuid 61204bbb-04fb-4545-ade1-5665c733c5bd {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue" returned: 0 in 0.057s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'migration_context' on Instance uuid 61204bbb-04fb-4545-ade1-5665c733c5bd {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Start _get_guest_xml network_info=[{"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "vif_mac": "fa:16:3e:8f:a9:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'resources' on Instance uuid 61204bbb-04fb-4545-ade1-5665c733c5bd {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:14:54 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'numa_topology' on Instance uuid 61204bbb-04fb-4545-ade1-5665c733c5bd {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:14:55 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:14:55 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'vcpu_model' on Instance uuid 61204bbb-04fb-4545-ade1-5665c733c5bd {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-7248979',display_name='tempest-ServerRescueNegativeTestJSON-server-7248979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-7248979',id=24,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:13:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31c373270f804948a04c8125848fa181',ramdisk_id='',reservation_id='r-yo5jzi9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-242021724',owner_user_name='tempest-ServerRescueNegativeTestJSON-242021724-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:13:11Z,user_data=None,user_id='8d63779eda794ef0b2413ac1483f88b8',uuid=61204bbb-04fb-4545-ade1-5665c733c5bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "vif_mac": "fa:16:3e:8f:a9:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converting VIF {"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "vif_mac": "fa:16:3e:8f:a9:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a9:e1,bridge_name='br-int',has_traffic_filtering=True,id=6eb4af06-413f-41c6-892b-f2d66653509f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb4af06-41') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'pci_devices' on Instance uuid 61204bbb-04fb-4545-ade1-5665c733c5bd {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:14:55 user nova-compute[71516]:   <uuid>61204bbb-04fb-4545-ade1-5665c733c5bd</uuid>
Apr 11 23:14:55 user nova-compute[71516]:   <name>instance-00000018</name>
Apr 11 23:14:55 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:14:55 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:14:55 user nova-compute[71516]:   <metadata>
Apr 11 23:14:55 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:14:55 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:14:55 user nova-compute[71516]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-7248979</nova:name>
Apr 11 23:14:55 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:14:55</nova:creationTime>
Apr 11 23:14:55 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:14:55 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:14:55 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:14:55 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:14:55 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:14:55 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:14:55 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:14:55 user nova-compute[71516]:       <nova:owner>
Apr 11 23:14:55 user nova-compute[71516]:         <nova:user uuid="8d63779eda794ef0b2413ac1483f88b8">tempest-ServerRescueNegativeTestJSON-242021724-project-member</nova:user>
Apr 11 23:14:55 user nova-compute[71516]:         <nova:project uuid="31c373270f804948a04c8125848fa181">tempest-ServerRescueNegativeTestJSON-242021724</nova:project>
Apr 11 23:14:55 user nova-compute[71516]:       </nova:owner>
Apr 11 23:14:55 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:14:55 user nova-compute[71516]:       <nova:ports>
Apr 11 23:14:55 user nova-compute[71516]:         <nova:port uuid="6eb4af06-413f-41c6-892b-f2d66653509f">
Apr 11 23:14:55 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:14:55 user nova-compute[71516]:         </nova:port>
Apr 11 23:14:55 user nova-compute[71516]:       </nova:ports>
Apr 11 23:14:55 user nova-compute[71516]:     </nova:instance>
Apr 11 23:14:55 user nova-compute[71516]:   </metadata>
Apr 11 23:14:55 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:14:55 user nova-compute[71516]:     <system>
Apr 11 23:14:55 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:14:55 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:14:55 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:14:55 user nova-compute[71516]:       <entry name="serial">61204bbb-04fb-4545-ade1-5665c733c5bd</entry>
Apr 11 23:14:55 user nova-compute[71516]:       <entry name="uuid">61204bbb-04fb-4545-ade1-5665c733c5bd</entry>
Apr 11 23:14:55 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:14:55 user nova-compute[71516]:     </system>
Apr 11 23:14:55 user nova-compute[71516]:   </sysinfo>
Apr 11 23:14:55 user nova-compute[71516]:   <os>
Apr 11 23:14:55 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:14:55 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:14:55 user nova-compute[71516]:   </os>
Apr 11 23:14:55 user nova-compute[71516]:   <features>
Apr 11 23:14:55 user nova-compute[71516]:     <acpi/>
Apr 11 23:14:55 user nova-compute[71516]:     <apic/>
Apr 11 23:14:55 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:14:55 user nova-compute[71516]:   </features>
Apr 11 23:14:55 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:14:55 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:14:55 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:14:55 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:14:55 user nova-compute[71516]:   </clock>
Apr 11 23:14:55 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:14:55 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:14:55 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:14:55 user nova-compute[71516]:   </cpu>
Apr 11 23:14:55 user nova-compute[71516]:   <devices>
Apr 11 23:14:55 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:14:55 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:14:55 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue"/>
Apr 11 23:14:55 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:14:55 user nova-compute[71516]:     </disk>
Apr 11 23:14:55 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:14:55 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:14:55 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk"/>
Apr 11 23:14:55 user nova-compute[71516]:       <target dev="vdb" bus="virtio"/>
Apr 11 23:14:55 user nova-compute[71516]:     </disk>
Apr 11 23:14:55 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:14:55 user nova-compute[71516]:       <mac address="fa:16:3e:8f:a9:e1"/>
Apr 11 23:14:55 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:14:55 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:14:55 user nova-compute[71516]:       <target dev="tap6eb4af06-41"/>
Apr 11 23:14:55 user nova-compute[71516]:     </interface>
Apr 11 23:14:55 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:14:55 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/console.log" append="off"/>
Apr 11 23:14:55 user nova-compute[71516]:     </serial>
Apr 11 23:14:55 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:14:55 user nova-compute[71516]:     <video>
Apr 11 23:14:55 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:14:55 user nova-compute[71516]:     </video>
Apr 11 23:14:55 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:14:55 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:14:55 user nova-compute[71516]:     </rng>
Apr 11 23:14:55 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:14:55 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:14:55 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:14:55 user nova-compute[71516]:     </memballoon>
Apr 11 23:14:55 user nova-compute[71516]:   </devices>
Apr 11 23:14:55 user nova-compute[71516]: </domain>
Apr 11 23:14:55 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:14:55 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Instance destroyed successfully.
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:14:55 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No VIF found with MAC fa:16:3e:8f:a9:e1, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:14:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-8bf3c47e-1a7a-45df-bd79-4941a4ee60a6 req-437d83fe-c2bd-4834-abd7-2a58b28e8704 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received event network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8bf3c47e-1a7a-45df-bd79-4941a4ee60a6 req-437d83fe-c2bd-4834-abd7-2a58b28e8704 service nova] Acquiring lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8bf3c47e-1a7a-45df-bd79-4941a4ee60a6 req-437d83fe-c2bd-4834-abd7-2a58b28e8704 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8bf3c47e-1a7a-45df-bd79-4941a4ee60a6 req-437d83fe-c2bd-4834-abd7-2a58b28e8704 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-8bf3c47e-1a7a-45df-bd79-4941a4ee60a6 req-437d83fe-c2bd-4834-abd7-2a58b28e8704 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] No waiting events found dispatching network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:14:56 user nova-compute[71516]: WARNING nova.compute.manager [req-8bf3c47e-1a7a-45df-bd79-4941a4ee60a6 req-437d83fe-c2bd-4834-abd7-2a58b28e8704 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received unexpected event network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f for instance with vm_state active and task_state rescuing.
Apr 11 23:14:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254883.0717342, f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:14:58 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] VM Stopped (Lifecycle Event)
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ad21ecbd-0589-4aba-89c1-e5ef98e51e6c None None] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received event network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] Acquiring lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] No waiting events found dispatching network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:14:58 user nova-compute[71516]: WARNING nova.compute.manager [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received unexpected event network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f for instance with vm_state active and task_state rescuing.
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received event network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] Acquiring lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] No waiting events found dispatching network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:14:58 user nova-compute[71516]: WARNING nova.compute.manager [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received unexpected event network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f for instance with vm_state active and task_state rescuing.
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for 61204bbb-04fb-4545-ade1-5665c733c5bd due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254898.5846858, 61204bbb-04fb-4545-ade1-5665c733c5bd => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:14:58 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] VM Resumed (Lifecycle Event)
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:14:58 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254898.587155, 61204bbb-04fb-4545-ade1-5665c733c5bd => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:14:58 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] VM Started (Lifecycle Event)
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:14:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:14:58 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 23:15:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "410941af-9184-44ae-b416-b2a265c24f02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "410941af-9184-44ae-b416-b2a265c24f02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG nova.objects.instance [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'flavor' on Instance uuid 410941af-9184-44ae-b416-b2a265c24f02 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:15:01 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Ignoring supplied device name: /dev/vdb
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "410941af-9184-44ae-b416-b2a265c24f02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "410941af-9184-44ae-b416-b2a265c24f02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "410941af-9184-44ae-b416-b2a265c24f02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:01 user nova-compute[71516]: INFO nova.compute.manager [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Attaching volume 340f7fcf-e01d-4c44-81c4-4dae8065c28d to /dev/vdb
Apr 11 23:15:01 user nova-compute[71516]: DEBUG os_brick.utils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e38bf6-abda-4ecc-980b-cbbdb8222ab6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[978325a3-47ba-47af-a31d-1d2ae1654ba1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a20ca63-3bbe-4c88-ab74-55bba01b6ed1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a995b0d2-9d17-4e8b-96e8-4e431085345e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:15:01 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:15:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[720f1944-d679-40fc-b0bc-4274289771f1]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG os_brick.utils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:15:01 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Updating existing volume attachment record: 663e9c1a-bc9e-47f8-9ab3-9d90a0e8f8d7 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:15:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhnSMXbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:15:05 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:15:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:15:05 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:15:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:15:05 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:15:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8fc4b5-af89-4440-a9b7-658c09a339ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:15:05 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe69f7f-e8a0-49a4-9aa4-8f2afecfb91c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d] added
Apr 11 23:15:05 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeb0984-8b6f-498b-9c1b-067f302632f1]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d62eb2-dca0-43f9-92fe-febf572c308a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZhnSMXbJ {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZhnSMXbJ" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a950f910-3021-45c5-bdaf-a98fdc2a3e24]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZhnSMXbJ'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce2fc1c-6f99-4578-98e3-9d342505b0c2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e303bc-94cf-4014-9933-ed6f4dc0afb5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:06 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:06 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[549f8de7-db54-49dd-996c-7eda3c01f1c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d, portal: 172.16.0.220,3260]
Apr 11 23:15:06 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d, portal: 172.16.0.220,3260] successful.
Apr 11 23:15:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1b2cd3-0af9-4abb-9ae0-82759340da1c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8b24d9-1978-4822-a357-29725a2d409f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:06 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:06 user nova-compute[71516]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d (non-flash)
Apr 11 23:15:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:06 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:06 user nova-compute[71516]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d (non-flash)
Apr 11 23:15:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5314396-bf6e-4d7a-9de2-04648a48d58d]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:15:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhnSMXbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:15:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:15:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26135646565623037', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:15:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135646565623037', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:15:07 user nova-compute[71516]: DEBUG nova.objects.instance [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'flavor' on Instance uuid 410941af-9184-44ae-b416-b2a265c24f02 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:15:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:15:07 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:15:07 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:15:07 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:15:07 user nova-compute[71516]:   <serial>340f7fcf-e01d-4c44-81c4-4dae8065c28d</serial>
Apr 11 23:15:07 user nova-compute[71516]: </disk>
Apr 11 23:15:07 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:15:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:15:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:15:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] No VIF found with MAC fa:16:3e:1e:24:83, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:15:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "410941af-9184-44ae-b416-b2a265c24f02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.269s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:15:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "410941af-9184-44ae-b416-b2a265c24f02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "410941af-9184-44ae-b416-b2a265c24f02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:14 user nova-compute[71516]: INFO nova.compute.manager [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Detaching volume 340f7fcf-e01d-4c44-81c4-4dae8065c28d
Apr 11 23:15:14 user nova-compute[71516]: INFO nova.virt.block_device [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Attempting to driver detach volume 340f7fcf-e01d-4c44-81c4-4dae8065c28d from mountpoint /dev/vdb
Apr 11 23:15:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Attempting to detach device vdb from instance 410941af-9184-44ae-b416-b2a265c24f02 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:15:14 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:15:14 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:15:14 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:15:14 user nova-compute[71516]:   <serial>340f7fcf-e01d-4c44-81c4-4dae8065c28d</serial>
Apr 11 23:15:14 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:15:14 user nova-compute[71516]: </disk>
Apr 11 23:15:14 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:15:14 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Successfully detached device vdb from instance 410941af-9184-44ae-b416-b2a265c24f02 from the persistent domain config.
Apr 11 23:15:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 410941af-9184-44ae-b416-b2a265c24f02 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:15:14 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:15:14 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:15:14 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:15:14 user nova-compute[71516]:   <serial>340f7fcf-e01d-4c44-81c4-4dae8065c28d</serial>
Apr 11 23:15:14 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:15:14 user nova-compute[71516]: </disk>
Apr 11 23:15:14 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "410941af-9184-44ae-b416-b2a265c24f02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681254914.7087963, 410941af-9184-44ae-b416-b2a265c24f02 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 410941af-9184-44ae-b416-b2a265c24f02 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:15:14 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Successfully detached device vdb from instance 410941af-9184-44ae-b416-b2a265c24f02 from the live domain config.
Apr 11 23:15:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhnSMXbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:15:14 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b977fd3f-4167-4970-ad68-93bc955e7830]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:15:14 user nova-compute[71516]: No targets found.
Apr 11 23:15:14 user nova-compute[71516]: iSNS:
Apr 11 23:15:14 user nova-compute[71516]: No targets found.
Apr 11 23:15:14 user nova-compute[71516]: STATIC:
Apr 11 23:15:14 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d
Apr 11 23:15:14 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:15:14 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:15:14 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5
Apr 11 23:15:14 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:15:14 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:15:14 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd
Apr 11 23:15:14 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:15:14 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:15:14 user nova-compute[71516]: FIRMWARE:
Apr 11 23:15:14 user nova-compute[71516]: No targets found.
Apr 11 23:15:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:15:14 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:15:14 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ac15ba-fe05-4a44-bf51-865c8d6d0007]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c721a1ce-dc36-419f-949f-f9605d8860f0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:14 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:14 user nova-compute[71516]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d (non-flash)
Apr 11 23:15:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:14 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:14 user nova-compute[71516]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d (non-flash)
Apr 11 23:15:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c482290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a59c25-f16e-4fe8-90b6-457c1f22dbcf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e63da56-5660-44b1-a75d-93b06eeb2047]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c796dbea-3282-4e0e-9170-3fc7e5631042]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52fb28e-f43f-407d-bfae-b2ba1f2a23d6]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a97114-48f3-4ca4-ba53-0399f980a676]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[67251e7a-4e5d-4f55-93bd-fafb80fdeed2]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d, portal: 172.16.0.220,3260]
Apr 11 23:15:14 user nova-compute[71516]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d, portal: 172.16.0.220,3260] successful.
Apr 11 23:15:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[143405f7-a2df-4823-a9a0-a95ed75704f6]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] <== disconnect_volume: return (306ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG nova.objects.instance [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'flavor' on Instance uuid 410941af-9184-44ae-b416-b2a265c24f02 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "410941af-9184-44ae-b416-b2a265c24f02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.732s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "410941af-9184-44ae-b416-b2a265c24f02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.605s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "410941af-9184-44ae-b416-b2a265c24f02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "410941af-9184-44ae-b416-b2a265c24f02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "410941af-9184-44ae-b416-b2a265c24f02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:15 user nova-compute[71516]: INFO nova.compute.manager [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Terminating instance
Apr 11 23:15:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:15:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-80befde0-c287-460f-bcb6-0fd0aeb28d80 req-25411090-ad3b-4ae6-aae2-43d4a6a50565 service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Received event network-vif-unplugged-ad12511e-bbda-4cfd-9ea9-093053aedb3e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-80befde0-c287-460f-bcb6-0fd0aeb28d80 req-25411090-ad3b-4ae6-aae2-43d4a6a50565 service nova] Acquiring lock "410941af-9184-44ae-b416-b2a265c24f02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-80befde0-c287-460f-bcb6-0fd0aeb28d80 req-25411090-ad3b-4ae6-aae2-43d4a6a50565 service nova] Lock "410941af-9184-44ae-b416-b2a265c24f02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-80befde0-c287-460f-bcb6-0fd0aeb28d80 req-25411090-ad3b-4ae6-aae2-43d4a6a50565 service nova] Lock "410941af-9184-44ae-b416-b2a265c24f02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-80befde0-c287-460f-bcb6-0fd0aeb28d80 req-25411090-ad3b-4ae6-aae2-43d4a6a50565 service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] No waiting events found dispatching network-vif-unplugged-ad12511e-bbda-4cfd-9ea9-093053aedb3e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-80befde0-c287-460f-bcb6-0fd0aeb28d80 req-25411090-ad3b-4ae6-aae2-43d4a6a50565 service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Received event network-vif-unplugged-ad12511e-bbda-4cfd-9ea9-093053aedb3e for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:15:16 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Instance destroyed successfully.
Apr 11 23:15:16 user nova-compute[71516]: DEBUG nova.objects.instance [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'resources' on Instance uuid 410941af-9184-44ae-b416-b2a265c24f02 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-970336588',display_name='tempest-VolumesSnapshotTestJSON-instance-970336588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-970336588',id=25,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:13:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='154fad18f802436d95b15503e470d942',ramdisk_id='',reservation_id='r-vq7oss3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-76917881',owner_user_name='tempest-VolumesSnapshotTestJSON-76917881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:13:18Z,user_data=None,user_id='e3995d8045154666b0ae890dd3de5ef3',uuid=410941af-9184-44ae-b416-b2a265c24f02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "address": "fa:16:3e:1e:24:83", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad12511e-bb", "ovs_interfaceid": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Converting VIF {"id": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "address": "fa:16:3e:1e:24:83", "network": {"id": "9d69aaba-efae-4f2d-892b-03a069468558", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688503739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "154fad18f802436d95b15503e470d942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad12511e-bb", "ovs_interfaceid": "ad12511e-bbda-4cfd-9ea9-093053aedb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:24:83,bridge_name='br-int',has_traffic_filtering=True,id=ad12511e-bbda-4cfd-9ea9-093053aedb3e,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad12511e-bb') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG os_vif [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:24:83,bridge_name='br-int',has_traffic_filtering=True,id=ad12511e-bbda-4cfd-9ea9-093053aedb3e,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad12511e-bb') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad12511e-bb, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:16 user nova-compute[71516]: INFO os_vif [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:24:83,bridge_name='br-int',has_traffic_filtering=True,id=ad12511e-bbda-4cfd-9ea9-093053aedb3e,network=Network(9d69aaba-efae-4f2d-892b-03a069468558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad12511e-bb')
Apr 11 23:15:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhnSMXbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:15:16 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:15:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7873fbe8-9d5b-46d3-ac64-f0efd665aad8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:15:16 user nova-compute[71516]: No targets found.
Apr 11 23:15:16 user nova-compute[71516]: iSNS:
Apr 11 23:15:16 user nova-compute[71516]: No targets found.
Apr 11 23:15:16 user nova-compute[71516]: STATIC:
Apr 11 23:15:16 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5
Apr 11 23:15:16 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:15:16 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:15:16 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd
Apr 11 23:15:16 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:15:16 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:15:16 user nova-compute[71516]: FIRMWARE:
Apr 11 23:15:16 user nova-compute[71516]: No targets found.
Apr 11 23:15:16 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:15:16 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:15:16 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:340f7fcf-e01d-4c44-81c4-4dae8065c28d', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b4025c-5934-494d-bf64-85bbfdd96536]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fe4d9e-8e09-47e8-a50c-34bf008e8565]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:16 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:16 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:16 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:16 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c483be0>, {}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Disconnecting from: [] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] <== disconnect_volume: return (74ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:15:16 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Deleting instance files /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02_del
Apr 11 23:15:16 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Deletion of /opt/stack/data/nova/instances/410941af-9184-44ae-b416-b2a265c24f02_del complete
Apr 11 23:15:16 user nova-compute[71516]: INFO nova.compute.manager [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 11 23:15:16 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:15:16 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 410941af-9184-44ae-b416-b2a265c24f02] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:15:17 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:15:17 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Took 0.48 seconds to deallocate network for instance.
Apr 11 23:15:17 user nova-compute[71516]: WARNING nova.volume.cinder [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Attachment 663e9c1a-bc9e-47f8-9ab3-9d90a0e8f8d7 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 663e9c1a-bc9e-47f8-9ab3-9d90a0e8f8d7. (HTTP 404) (Request-ID: req-83d0e488-b416-43c0-b06d-6f19b7d035ff)
Apr 11 23:15:17 user nova-compute[71516]: INFO nova.compute.manager [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Took 0.02 seconds to detach 1 volumes for instance.
Apr 11 23:15:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-c60f52b9-14d3-4300-9819-241bb99db6e2 req-d3cde9c0-aa30-4757-8bff-50a8dfde0988 service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Received event network-vif-deleted-ad12511e-bbda-4cfd-9ea9-093053aedb3e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:17 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:15:17 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:15:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:17 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Deleted allocations for instance 410941af-9184-44ae-b416-b2a265c24f02
Apr 11 23:15:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "410941af-9184-44ae-b416-b2a265c24f02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.880s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:15:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:17 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:15:17 user nova-compute[71516]: INFO nova.compute.claims [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Claim successful on node user
Apr 11 23:15:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-246b0ca3-e7a3-4e9b-8d20-41201399e42c req-c6eaef37-f1ed-46ab-b13d-24a639579bd4 service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Received event network-vif-plugged-ad12511e-bbda-4cfd-9ea9-093053aedb3e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-246b0ca3-e7a3-4e9b-8d20-41201399e42c req-c6eaef37-f1ed-46ab-b13d-24a639579bd4 service nova] Acquiring lock "410941af-9184-44ae-b416-b2a265c24f02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-246b0ca3-e7a3-4e9b-8d20-41201399e42c req-c6eaef37-f1ed-46ab-b13d-24a639579bd4 service nova] Lock "410941af-9184-44ae-b416-b2a265c24f02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-246b0ca3-e7a3-4e9b-8d20-41201399e42c req-c6eaef37-f1ed-46ab-b13d-24a639579bd4 service nova] Lock "410941af-9184-44ae-b416-b2a265c24f02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-246b0ca3-e7a3-4e9b-8d20-41201399e42c req-c6eaef37-f1ed-46ab-b13d-24a639579bd4 service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] No waiting events found dispatching network-vif-plugged-ad12511e-bbda-4cfd-9ea9-093053aedb3e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:15:18 user nova-compute[71516]: WARNING nova.compute.manager [req-246b0ca3-e7a3-4e9b-8d20-41201399e42c req-c6eaef37-f1ed-46ab-b13d-24a639579bd4 service nova] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Received unexpected event network-vif-plugged-ad12511e-bbda-4cfd-9ea9-093053aedb3e for instance with vm_state deleted and task_state None.
Apr 11 23:15:18 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG nova.network.neutron [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:15:18 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:15:18 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG nova.policy [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:15:18 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Creating image(s)
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "/opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "/opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.158s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk 1073741824" returned: 0 in 0.047s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:15:18 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Cannot resize image /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG nova.objects.instance [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'migration_context' on Instance uuid f1a98583-cd58-4078-999f-f2bfb3a50c48 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG nova.network.neutron [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Successfully created port: cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Ensure instance console log exists: /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG nova.network.neutron [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Successfully updated port: cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "refresh_cache-f1a98583-cd58-4078-999f-f2bfb3a50c48" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquired lock "refresh_cache-f1a98583-cd58-4078-999f-f2bfb3a50c48" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG nova.network.neutron [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG nova.compute.manager [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Received event network-changed-cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG nova.compute.manager [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Refreshing instance network info cache due to event network-changed-cab6e033-a51b-4b0b-9e76-c55de3afcef6. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] Acquiring lock "refresh_cache-f1a98583-cd58-4078-999f-f2bfb3a50c48" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:15:19 user nova-compute[71516]: DEBUG nova.network.neutron [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.network.neutron [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Updating instance_info_cache with network_info: [{"id": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "address": "fa:16:3e:64:cb:bc", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab6e033-a5", "ovs_interfaceid": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Releasing lock "refresh_cache-f1a98583-cd58-4078-999f-f2bfb3a50c48" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Instance network_info: |[{"id": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "address": "fa:16:3e:64:cb:bc", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab6e033-a5", "ovs_interfaceid": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] Acquired lock "refresh_cache-f1a98583-cd58-4078-999f-f2bfb3a50c48" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.network.neutron [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Refreshing network info cache for port cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Start _get_guest_xml network_info=[{"id": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "address": "fa:16:3e:64:cb:bc", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab6e033-a5", "ovs_interfaceid": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:15:20 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:15:20 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-131271423',display_name='tempest-AttachVolumeNegativeTest-server-131271423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-131271423',id=27,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqiBFzmneB80tP6Tj+qnl3+1eC133Qn4aI89AQCOP2iFxgPQXn34wxavPyq4/G//gf7atdxb0KzJCdIbFr2aiqBtboY8aU8MocAETUKCiEdjsmvXRKyD49TLOFZwfjIOg==',key_name='tempest-keypair-357942564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f29d28c472c4f65b8437ce443d208c7',ramdisk_id='',reservation_id='r-0lyjb1pe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2123485934',owner_user_name='tempest-AttachVolumeNegativeTest-2123485934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da1389f3e27f49f394598636d041a9c9',uuid=f1a98583-cd58-4078-999f-f2bfb3a50c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "address": "fa:16:3e:64:cb:bc", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab6e033-a5", "ovs_interfaceid": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converting VIF {"id": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "address": "fa:16:3e:64:cb:bc", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab6e033-a5", "ovs_interfaceid": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:cb:bc,bridge_name='br-int',has_traffic_filtering=True,id=cab6e033-a51b-4b0b-9e76-c55de3afcef6,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab6e033-a5') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.objects.instance [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'pci_devices' on Instance uuid f1a98583-cd58-4078-999f-f2bfb3a50c48 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:15:20 user nova-compute[71516]:   <uuid>f1a98583-cd58-4078-999f-f2bfb3a50c48</uuid>
Apr 11 23:15:20 user nova-compute[71516]:   <name>instance-0000001b</name>
Apr 11 23:15:20 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:15:20 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:15:20 user nova-compute[71516]:   <metadata>
Apr 11 23:15:20 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:15:20 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:15:20 user nova-compute[71516]:       <nova:name>tempest-AttachVolumeNegativeTest-server-131271423</nova:name>
Apr 11 23:15:20 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:15:20</nova:creationTime>
Apr 11 23:15:20 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:15:20 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:15:20 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:15:20 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:15:20 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:15:20 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:15:20 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:15:20 user nova-compute[71516]:       <nova:owner>
Apr 11 23:15:20 user nova-compute[71516]:         <nova:user uuid="da1389f3e27f49f394598636d041a9c9">tempest-AttachVolumeNegativeTest-2123485934-project-member</nova:user>
Apr 11 23:15:20 user nova-compute[71516]:         <nova:project uuid="9f29d28c472c4f65b8437ce443d208c7">tempest-AttachVolumeNegativeTest-2123485934</nova:project>
Apr 11 23:15:20 user nova-compute[71516]:       </nova:owner>
Apr 11 23:15:20 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:15:20 user nova-compute[71516]:       <nova:ports>
Apr 11 23:15:20 user nova-compute[71516]:         <nova:port uuid="cab6e033-a51b-4b0b-9e76-c55de3afcef6">
Apr 11 23:15:20 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 23:15:20 user nova-compute[71516]:         </nova:port>
Apr 11 23:15:20 user nova-compute[71516]:       </nova:ports>
Apr 11 23:15:20 user nova-compute[71516]:     </nova:instance>
Apr 11 23:15:20 user nova-compute[71516]:   </metadata>
Apr 11 23:15:20 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:15:20 user nova-compute[71516]:     <system>
Apr 11 23:15:20 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:15:20 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:15:20 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:15:20 user nova-compute[71516]:       <entry name="serial">f1a98583-cd58-4078-999f-f2bfb3a50c48</entry>
Apr 11 23:15:20 user nova-compute[71516]:       <entry name="uuid">f1a98583-cd58-4078-999f-f2bfb3a50c48</entry>
Apr 11 23:15:20 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:15:20 user nova-compute[71516]:     </system>
Apr 11 23:15:20 user nova-compute[71516]:   </sysinfo>
Apr 11 23:15:20 user nova-compute[71516]:   <os>
Apr 11 23:15:20 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:15:20 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:15:20 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:15:20 user nova-compute[71516]:   </os>
Apr 11 23:15:20 user nova-compute[71516]:   <features>
Apr 11 23:15:20 user nova-compute[71516]:     <acpi/>
Apr 11 23:15:20 user nova-compute[71516]:     <apic/>
Apr 11 23:15:20 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:15:20 user nova-compute[71516]:   </features>
Apr 11 23:15:20 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:15:20 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:15:20 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:15:20 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:15:20 user nova-compute[71516]:   </clock>
Apr 11 23:15:20 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:15:20 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:15:20 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:15:20 user nova-compute[71516]:   </cpu>
Apr 11 23:15:20 user nova-compute[71516]:   <devices>
Apr 11 23:15:20 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:15:20 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:15:20 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk"/>
Apr 11 23:15:20 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:15:20 user nova-compute[71516]:     </disk>
Apr 11 23:15:20 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:15:20 user nova-compute[71516]:       <mac address="fa:16:3e:64:cb:bc"/>
Apr 11 23:15:20 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:15:20 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:15:20 user nova-compute[71516]:       <target dev="tapcab6e033-a5"/>
Apr 11 23:15:20 user nova-compute[71516]:     </interface>
Apr 11 23:15:20 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:15:20 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/console.log" append="off"/>
Apr 11 23:15:20 user nova-compute[71516]:     </serial>
Apr 11 23:15:20 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:15:20 user nova-compute[71516]:     <video>
Apr 11 23:15:20 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:15:20 user nova-compute[71516]:     </video>
Apr 11 23:15:20 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:15:20 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:15:20 user nova-compute[71516]:     </rng>
Apr 11 23:15:20 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:15:20 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:15:20 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:15:20 user nova-compute[71516]:     </memballoon>
Apr 11 23:15:20 user nova-compute[71516]:   </devices>
Apr 11 23:15:20 user nova-compute[71516]: </domain>
Apr 11 23:15:20 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-131271423',display_name='tempest-AttachVolumeNegativeTest-server-131271423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-131271423',id=27,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqiBFzmneB80tP6Tj+qnl3+1eC133Qn4aI89AQCOP2iFxgPQXn34wxavPyq4/G//gf7atdxb0KzJCdIbFr2aiqBtboY8aU8MocAETUKCiEdjsmvXRKyD49TLOFZwfjIOg==',key_name='tempest-keypair-357942564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f29d28c472c4f65b8437ce443d208c7',ramdisk_id='',reservation_id='r-0lyjb1pe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2123485934',owner_user_name='tempest-AttachVolumeNegativeTest-2123485934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da1389f3e27f49f394598636d041a9c9',uuid=f1a98583-cd58-4078-999f-f2bfb3a50c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "address": "fa:16:3e:64:cb:bc", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab6e033-a5", "ovs_interfaceid": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converting VIF {"id": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "address": "fa:16:3e:64:cb:bc", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab6e033-a5", "ovs_interfaceid": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:cb:bc,bridge_name='br-int',has_traffic_filtering=True,id=cab6e033-a51b-4b0b-9e76-c55de3afcef6,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab6e033-a5') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG os_vif [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:cb:bc,bridge_name='br-int',has_traffic_filtering=True,id=cab6e033-a51b-4b0b-9e76-c55de3afcef6,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab6e033-a5') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcab6e033-a5, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcab6e033-a5, col_values=(('external_ids', {'iface-id': 'cab6e033-a51b-4b0b-9e76-c55de3afcef6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:cb:bc', 'vm-uuid': 'f1a98583-cd58-4078-999f-f2bfb3a50c48'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:20 user nova-compute[71516]: INFO os_vif [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:cb:bc,bridge_name='br-int',has_traffic_filtering=True,id=cab6e033-a51b-4b0b-9e76-c55de3afcef6,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab6e033-a5')
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No VIF found with MAC fa:16:3e:64:cb:bc, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.network.neutron [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Updated VIF entry in instance network info cache for port cab6e033-a51b-4b0b-9e76-c55de3afcef6. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG nova.network.neutron [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Updating instance_info_cache with network_info: [{"id": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "address": "fa:16:3e:64:cb:bc", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab6e033-a5", "ovs_interfaceid": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:15:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] Releasing lock "refresh_cache-f1a98583-cd58-4078-999f-f2bfb3a50c48" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:15:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-a18e8c41-504c-48a7-a556-2d4f52ef1f4d req-35e89380-753d-4fc8-9128-935d17235875 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Received event network-vif-plugged-cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a18e8c41-504c-48a7-a556-2d4f52ef1f4d req-35e89380-753d-4fc8-9128-935d17235875 service nova] Acquiring lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a18e8c41-504c-48a7-a556-2d4f52ef1f4d req-35e89380-753d-4fc8-9128-935d17235875 service nova] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a18e8c41-504c-48a7-a556-2d4f52ef1f4d req-35e89380-753d-4fc8-9128-935d17235875 service nova] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-a18e8c41-504c-48a7-a556-2d4f52ef1f4d req-35e89380-753d-4fc8-9128-935d17235875 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] No waiting events found dispatching network-vif-plugged-cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:15:21 user nova-compute[71516]: WARNING nova.compute.manager [req-a18e8c41-504c-48a7-a556-2d4f52ef1f4d req-35e89380-753d-4fc8-9128-935d17235875 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Received unexpected event network-vif-plugged-cab6e033-a51b-4b0b-9e76-c55de3afcef6 for instance with vm_state building and task_state spawning.
Apr 11 23:15:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:23 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:15:23 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 23:15:23 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] There are 0 instances to clean {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 23:15:23 user nova-compute[71516]: DEBUG nova.network.neutron [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Port 961d8195-c0d7-49eb-bfd7-05ee4b3e6112 binding to destination host user is already ACTIVE {{(pid=71516) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 23:15:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:15:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquired lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:15:23 user nova-compute[71516]: DEBUG nova.network.neutron [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:15:23 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254923.9944134, f1a98583-cd58-4078-999f-f2bfb3a50c48 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:15:23 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] VM Resumed (Lifecycle Event)
Apr 11 23:15:23 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:15:23 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:15:24 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Instance spawned successfully.
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.network.neutron [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating instance_info_cache with network_info: [{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:15:24 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254923.9945924, f1a98583-cd58-4078-999f-f2bfb3a50c48 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:15:24 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] VM Started (Lifecycle Event)
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Releasing lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-78ce0c60-874c-4bca-8d6e-2fc89063aaab req-0fdbfff8-3ac7-469d-bf1e-d7d9bd6f6154 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Received event network-vif-plugged-cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-78ce0c60-874c-4bca-8d6e-2fc89063aaab req-0fdbfff8-3ac7-469d-bf1e-d7d9bd6f6154 service nova] Acquiring lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-78ce0c60-874c-4bca-8d6e-2fc89063aaab req-0fdbfff8-3ac7-469d-bf1e-d7d9bd6f6154 service nova] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-78ce0c60-874c-4bca-8d6e-2fc89063aaab req-0fdbfff8-3ac7-469d-bf1e-d7d9bd6f6154 service nova] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-78ce0c60-874c-4bca-8d6e-2fc89063aaab req-0fdbfff8-3ac7-469d-bf1e-d7d9bd6f6154 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] No waiting events found dispatching network-vif-plugged-cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:15:24 user nova-compute[71516]: WARNING nova.compute.manager [req-78ce0c60-874c-4bca-8d6e-2fc89063aaab req-0fdbfff8-3ac7-469d-bf1e-d7d9bd6f6154 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Received unexpected event network-vif-plugged-cab6e033-a51b-4b0b-9e76-c55de3afcef6 for instance with vm_state building and task_state spawning.
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Creating tmpfile /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/tmpry02thad to verify with other compute node that the instance is on the same shared storage. {{(pid=71516) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 11 23:15:24 user nova-compute[71516]: INFO nova.compute.manager [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Took 5.67 seconds to spawn the instance on the hypervisor.
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:15:24 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:15:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:24 user nova-compute[71516]: INFO nova.compute.manager [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Took 6.39 seconds to build instance.
Apr 11 23:15:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.502s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-2e969c19-ce3f-45e6-a2cf-987838b81800 req-46874784-c7a2-453f-95ea-3ec569075c7f service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-unplugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2e969c19-ce3f-45e6-a2cf-987838b81800 req-46874784-c7a2-453f-95ea-3ec569075c7f service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2e969c19-ce3f-45e6-a2cf-987838b81800 req-46874784-c7a2-453f-95ea-3ec569075c7f service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2e969c19-ce3f-45e6-a2cf-987838b81800 req-46874784-c7a2-453f-95ea-3ec569075c7f service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-2e969c19-ce3f-45e6-a2cf-987838b81800 req-46874784-c7a2-453f-95ea-3ec569075c7f service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-unplugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:15:24 user nova-compute[71516]: WARNING nova.compute.manager [req-2e969c19-ce3f-45e6-a2cf-987838b81800 req-46874784-c7a2-453f-95ea-3ec569075c7f service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-unplugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state resized and task_state resize_reverting.
Apr 11 23:15:24 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance destroyed successfully.
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.objects.instance [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'resources' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1831107086',display_name='tempest-ServerActionsTestJSON-server-1247380178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1831107086',id=2,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-pn29cvap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=eed8cea5-9e5c-4467-8993-456cb3235fd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG os_vif [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap961d8195-c0, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:24 user nova-compute[71516]: INFO os_vif [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0')
Apr 11 23:15:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peWsXVHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:15:24 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:15:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[31acf1e3-4873-4c20-b362-da8d3849995b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:15:24 user nova-compute[71516]: No targets found.
Apr 11 23:15:24 user nova-compute[71516]: iSNS:
Apr 11 23:15:24 user nova-compute[71516]: No targets found.
Apr 11 23:15:24 user nova-compute[71516]: STATIC:
Apr 11 23:15:24 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5
Apr 11 23:15:24 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:15:24 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:15:24 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd
Apr 11 23:15:24 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:15:24 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:15:24 user nova-compute[71516]: FIRMWARE:
Apr 11 23:15:24 user nova-compute[71516]: No targets found.
Apr 11 23:15:24 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:15:24 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:15:24 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:15:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a60d21-c5bf-4b65-96e7-51d6395dafca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b0cfc1-1e6c-4475-91bf-4f5b4d93648d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:25 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:25 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:25 user nova-compute[71516]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:25 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c482dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5'): ({'sdb'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Removing single pathed devices sdb {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[33653f78-95ef-490e-b84e-7a8ea5adf59c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd06ec3-cc8a-412f-b6ec-b5f9bd0a1040]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flushing IO for device /dev/sdb {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7324a6-7d7a-4489-9277-d2a7075f3eb2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11cdd0a-9b23-4374-97e0-b794d14a3a75]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed3755d-925f-4228-9761-34950435f86e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c91c207-852d-4268-b408-e3fe043a83a9]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260]
Apr 11 23:15:25 user nova-compute[71516]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260] successful.
Apr 11 23:15:25 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e834ca-c160-4c55-8b24-93551165e43d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== disconnect_volume: return (309ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:15:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:26 user nova-compute[71516]: DEBUG nova.objects.instance [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'migration_context' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:15:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-9803211e-ebc4-4295-b445-de2790c724b0 req-a3566faa-fa1b-43bc-8af5-f8987184e554 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9803211e-ebc4-4295-b445-de2790c724b0 req-a3566faa-fa1b-43bc-8af5-f8987184e554 service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9803211e-ebc4-4295-b445-de2790c724b0 req-a3566faa-fa1b-43bc-8af5-f8987184e554 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9803211e-ebc4-4295-b445-de2790c724b0 req-a3566faa-fa1b-43bc-8af5-f8987184e554 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-9803211e-ebc4-4295-b445-de2790c724b0 req-a3566faa-fa1b-43bc-8af5-f8987184e554 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:15:26 user nova-compute[71516]: WARNING nova.compute.manager [req-9803211e-ebc4-4295-b445-de2790c724b0 req-a3566faa-fa1b-43bc-8af5-f8987184e554 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state resized and task_state resize_reverting.
Apr 11 23:15:26 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:15:26 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:15:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.596s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:26 user nova-compute[71516]: INFO nova.compute.manager [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Swapping old allocation on dict_keys(['4d8a043f-686c-4589-9f1b-5d9579db89a3']) held by migration 42989b85-5137-41a1-a2f6-d2c7aae7cf5e for instance
Apr 11 23:15:27 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Overwriting current allocation {'allocations': {'4d8a043f-686c-4589-9f1b-5d9579db89a3': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 32}}, 'project_id': '2fca37343b414de6b008ad79e022f858', 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'consumer_generation': 1} on consumer eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquired lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG nova.network.neutron [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG nova.network.neutron [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating instance_info_cache with network_info: [{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Releasing lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG os_brick.utils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9baff5-7df3-47af-a3dd-940d4ff5905b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19a3bbe-3358-40e1-8a45-1f9df1e7fe8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[30846d1c-978a-415c-a1de-52c204728565]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0ca47a-8501-4f3d-aea6-d19afee5e8c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:15:27 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:15:27 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5000d4b-6836-42d1-babd-23f03fd54bd8]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:15:27 user nova-compute[71516]: DEBUG os_brick.utils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:15:29 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:15:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:15:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:15:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:15:29 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:15:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating instance_info_cache with network_info: [{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:31 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254916.657036, 410941af-9184-44ae-b416-b2a265c24f02 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:15:31 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 410941af-9184-44ae-b416-b2a265c24f02] VM Stopped (Lifecycle Event)
Apr 11 23:15:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:15:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-199d11c0-5cfd-4501-9ee7-865843280c7c None None] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:15:32 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:15:32 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8218MB free_disk=26.316627502441406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e4d31874-4273-48bc-8811-89832d18b893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 29cf3139-d486-40da-8ab9-e695e5fd539b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Starting finish_revert_migration {{(pid=71516) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Start _get_guest_xml network_info=[{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peWsXVHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'eed8cea5-9e5c-4467-8993-456cb3235fd8', 'attached_at': '2023-04-11T23:15:32.000000', 'detached_at': '', 'volume_id': 'acc3f3e9-087d-4fc0-a462-78564949fef5', 'serial': 'acc3f3e9-087d-4fc0-a462-78564949fef5'}, 'disk_bus': 'virtio', 'attachment_id': '08449402-9020-4f84-aaf9-7ff1825d5e53', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:15:32 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:15:32 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.objects.instance [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'vcpu_model' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peWsXVHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:15:32 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:15:32 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:15:32 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e86ed9-c261-4a40-ad20-452be416f90c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:15:32 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ee2241-e368-4649-b90d-0f2c19d27bdc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5] added
Apr 11 23:15:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ec71f7-42e7-44df-90bb-d285db04ae00]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdfae3f-7ac1-4184-81a7-8206dec61372]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peWsXVHc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peWsXVHc" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbf78c9-7ced-4aa1-9dec-77757ba34bcc]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'peWsXVHc'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ce91f4-3ded-4ce6-ac20-b96cdd5c1ed2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4d7a42-6f75-4b53-ab9a-5d6afd40fc51]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed59b554-5f44-4bb6-99cd-229a7c2c5592]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260]
Apr 11 23:15:32 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260] successful.
Apr 11 23:15:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9698f64-fb2d-4a74-95d4-6d593a191fbe]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c1df3e-2e66-4dac-91b7-f0255cf0bd9b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:32 user nova-compute[71516]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:32 user nova-compute[71516]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9387d31-07ec-44b8-a4ed-19a306c3de0d]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:15:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peWsXVHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances with incomplete migration  {{(pid=71516) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23065616566336562', 'path': '/dev/sdb'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065616566336562', 'path': '/dev/sdb'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1831107086',display_name='tempest-ServerActionsTestJSON-server-1247380178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1831107086',id=2,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-pn29cvap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:15:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=eed8cea5-9e5c-4467-8993-456cb3235fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:15:33 user nova-compute[71516]:   <uuid>eed8cea5-9e5c-4467-8993-456cb3235fd8</uuid>
Apr 11 23:15:33 user nova-compute[71516]:   <name>instance-00000002</name>
Apr 11 23:15:33 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:15:33 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:15:33 user nova-compute[71516]:   <metadata>
Apr 11 23:15:33 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:15:33 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:15:33 user nova-compute[71516]:       <nova:name>tempest-ServerActionsTestJSON-server-1247380178</nova:name>
Apr 11 23:15:33 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:15:32</nova:creationTime>
Apr 11 23:15:33 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:15:33 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:15:33 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:15:33 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:15:33 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:15:33 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:15:33 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:15:33 user nova-compute[71516]:       <nova:owner>
Apr 11 23:15:33 user nova-compute[71516]:         <nova:user uuid="ddc7eb14e7174babb8680b4020243c97">tempest-ServerActionsTestJSON-813592275-project-member</nova:user>
Apr 11 23:15:33 user nova-compute[71516]:         <nova:project uuid="2fca37343b414de6b008ad79e022f858">tempest-ServerActionsTestJSON-813592275</nova:project>
Apr 11 23:15:33 user nova-compute[71516]:       </nova:owner>
Apr 11 23:15:33 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:15:33 user nova-compute[71516]:       <nova:ports>
Apr 11 23:15:33 user nova-compute[71516]:         <nova:port uuid="961d8195-c0d7-49eb-bfd7-05ee4b3e6112">
Apr 11 23:15:33 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:15:33 user nova-compute[71516]:         </nova:port>
Apr 11 23:15:33 user nova-compute[71516]:       </nova:ports>
Apr 11 23:15:33 user nova-compute[71516]:     </nova:instance>
Apr 11 23:15:33 user nova-compute[71516]:   </metadata>
Apr 11 23:15:33 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:15:33 user nova-compute[71516]:     <system>
Apr 11 23:15:33 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:15:33 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:15:33 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:15:33 user nova-compute[71516]:       <entry name="serial">eed8cea5-9e5c-4467-8993-456cb3235fd8</entry>
Apr 11 23:15:33 user nova-compute[71516]:       <entry name="uuid">eed8cea5-9e5c-4467-8993-456cb3235fd8</entry>
Apr 11 23:15:33 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:15:33 user nova-compute[71516]:     </system>
Apr 11 23:15:33 user nova-compute[71516]:   </sysinfo>
Apr 11 23:15:33 user nova-compute[71516]:   <os>
Apr 11 23:15:33 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:15:33 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:15:33 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:15:33 user nova-compute[71516]:   </os>
Apr 11 23:15:33 user nova-compute[71516]:   <features>
Apr 11 23:15:33 user nova-compute[71516]:     <acpi/>
Apr 11 23:15:33 user nova-compute[71516]:     <apic/>
Apr 11 23:15:33 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:15:33 user nova-compute[71516]:   </features>
Apr 11 23:15:33 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:15:33 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:15:33 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:15:33 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:15:33 user nova-compute[71516]:   </clock>
Apr 11 23:15:33 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:15:33 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:15:33 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:15:33 user nova-compute[71516]:   </cpu>
Apr 11 23:15:33 user nova-compute[71516]:   <devices>
Apr 11 23:15:33 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:15:33 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:15:33 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk"/>
Apr 11 23:15:33 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:15:33 user nova-compute[71516]:     </disk>
Apr 11 23:15:33 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:15:33 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:15:33 user nova-compute[71516]:       <source dev="/dev/sdb"/>
Apr 11 23:15:33 user nova-compute[71516]:       <target dev="vdb" bus="virtio"/>
Apr 11 23:15:33 user nova-compute[71516]:       <serial>acc3f3e9-087d-4fc0-a462-78564949fef5</serial>
Apr 11 23:15:33 user nova-compute[71516]:     </disk>
Apr 11 23:15:33 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:15:33 user nova-compute[71516]:       <mac address="fa:16:3e:ec:10:5e"/>
Apr 11 23:15:33 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:15:33 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:15:33 user nova-compute[71516]:       <target dev="tap961d8195-c0"/>
Apr 11 23:15:33 user nova-compute[71516]:     </interface>
Apr 11 23:15:33 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:15:33 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/console.log" append="off"/>
Apr 11 23:15:33 user nova-compute[71516]:     </serial>
Apr 11 23:15:33 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:15:33 user nova-compute[71516]:     <video>
Apr 11 23:15:33 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:15:33 user nova-compute[71516]:     </video>
Apr 11 23:15:33 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:15:33 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:15:33 user nova-compute[71516]:     </rng>
Apr 11 23:15:33 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:15:33 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:15:33 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:15:33 user nova-compute[71516]:     </memballoon>
Apr 11 23:15:33 user nova-compute[71516]:   </devices>
Apr 11 23:15:33 user nova-compute[71516]: </domain>
Apr 11 23:15:33 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1831107086',display_name='tempest-ServerActionsTestJSON-server-1247380178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1831107086',id=2,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-pn29cvap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:15:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=eed8cea5-9e5c-4467-8993-456cb3235fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG os_vif [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap961d8195-c0, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap961d8195-c0, col_values=(('external_ids', {'iface-id': '961d8195-c0d7-49eb-bfd7-05ee4b3e6112', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:10:5e', 'vm-uuid': 'eed8cea5-9e5c-4467-8993-456cb3235fd8'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:15:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:33 user nova-compute[71516]: INFO os_vif [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0')
Apr 11 23:15:34 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-6c67bda8-2a12-420b-aa75-ed1442689dd2 req-2a346fb0-2905-4fbe-b4db-8f3652a6bdff service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6c67bda8-2a12-420b-aa75-ed1442689dd2 req-2a346fb0-2905-4fbe-b4db-8f3652a6bdff service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6c67bda8-2a12-420b-aa75-ed1442689dd2 req-2a346fb0-2905-4fbe-b4db-8f3652a6bdff service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6c67bda8-2a12-420b-aa75-ed1442689dd2 req-2a346fb0-2905-4fbe-b4db-8f3652a6bdff service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-6c67bda8-2a12-420b-aa75-ed1442689dd2 req-2a346fb0-2905-4fbe-b4db-8f3652a6bdff service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:15:35 user nova-compute[71516]: WARNING nova.compute.manager [req-6c67bda8-2a12-420b-aa75-ed1442689dd2 req-2a346fb0-2905-4fbe-b4db-8f3652a6bdff service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state resized and task_state resize_reverting.
Apr 11 23:15:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:36 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:15:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:15:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for eed8cea5-9e5c-4467-8993-456cb3235fd8 due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:15:37 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254937.3730688, eed8cea5-9e5c-4467-8993-456cb3235fd8 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:15:37 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] VM Resumed (Lifecycle Event)
Apr 11 23:15:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:15:37 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance running successfully.
Apr 11 23:15:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] finish_revert_migration finished successfully. {{(pid=71516) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 11 23:15:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:15:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:15:37 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 23:15:37 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254937.37673, eed8cea5-9e5c-4467-8993-456cb3235fd8 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:15:37 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] VM Started (Lifecycle Event)
Apr 11 23:15:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:15:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:15:37 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 23:15:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-773bf017-7134-497a-aa30-a941ea633f94 req-703d8f06-c3f9-44b1-a14f-d77d1a39aed4 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-773bf017-7134-497a-aa30-a941ea633f94 req-703d8f06-c3f9-44b1-a14f-d77d1a39aed4 service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-773bf017-7134-497a-aa30-a941ea633f94 req-703d8f06-c3f9-44b1-a14f-d77d1a39aed4 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-773bf017-7134-497a-aa30-a941ea633f94 req-703d8f06-c3f9-44b1-a14f-d77d1a39aed4 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-773bf017-7134-497a-aa30-a941ea633f94 req-703d8f06-c3f9-44b1-a14f-d77d1a39aed4 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:15:37 user nova-compute[71516]: WARNING nova.compute.manager [req-773bf017-7134-497a-aa30-a941ea633f94 req-703d8f06-c3f9-44b1-a14f-d77d1a39aed4 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state resized and task_state resize_reverting.
Apr 11 23:15:37 user nova-compute[71516]: INFO nova.compute.manager [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating instance to original state: 'active'
Apr 11 23:15:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG nova.compute.manager [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Received event network-changed-d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG nova.compute.manager [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Refreshing instance network info cache due to event network-changed-d7aa2bb2-d610-4a03-b5fc-be956243a668. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] Acquiring lock "refresh_cache-29cf3139-d486-40da-8ab9-e695e5fd539b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] Acquired lock "refresh_cache-29cf3139-d486-40da-8ab9-e695e5fd539b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG nova.network.neutron [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Refreshing network info cache for port d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "29cf3139-d486-40da-8ab9-e695e5fd539b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:40 user nova-compute[71516]: INFO nova.compute.manager [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Terminating instance
Apr 11 23:15:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG nova.network.neutron [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Updated VIF entry in instance network info cache for port d7aa2bb2-d610-4a03-b5fc-be956243a668. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG nova.network.neutron [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Updating instance_info_cache with network_info: [{"id": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "address": "fa:16:3e:1c:33:92", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aa2bb2-d6", "ovs_interfaceid": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] Releasing lock "refresh_cache-29cf3139-d486-40da-8ab9-e695e5fd539b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-2d6756eb-2200-465c-8dbb-a362f39fe296 req-0d6c0d25-64c0-4cca-889a-cd5ba2d5900f service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Received event network-vif-unplugged-d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2d6756eb-2200-465c-8dbb-a362f39fe296 req-0d6c0d25-64c0-4cca-889a-cd5ba2d5900f service nova] Acquiring lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2d6756eb-2200-465c-8dbb-a362f39fe296 req-0d6c0d25-64c0-4cca-889a-cd5ba2d5900f service nova] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2d6756eb-2200-465c-8dbb-a362f39fe296 req-0d6c0d25-64c0-4cca-889a-cd5ba2d5900f service nova] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-2d6756eb-2200-465c-8dbb-a362f39fe296 req-0d6c0d25-64c0-4cca-889a-cd5ba2d5900f service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] No waiting events found dispatching network-vif-unplugged-d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-2d6756eb-2200-465c-8dbb-a362f39fe296 req-0d6c0d25-64c0-4cca-889a-cd5ba2d5900f service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Received event network-vif-unplugged-d7aa2bb2-d610-4a03-b5fc-be956243a668 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:15:41 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Instance destroyed successfully.
Apr 11 23:15:41 user nova-compute[71516]: DEBUG nova.objects.instance [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lazy-loading 'resources' on Instance uuid 29cf3139-d486-40da-8ab9-e695e5fd539b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-645887436',display_name='tempest-TestVolumeBootPattern-server-645887436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-645887436',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTeA7e6j/wrChwM1jogClH0JWZ33jOggStHh7lL1aQsrNXULlUHFl3iqjE9etghhRnMsyLyd4JqIILvNvoCcqVmiQ5foShdj8Q9wa2sI4sRIJCvJ4hRZ+cCGZXsMJkWw==',key_name='tempest-TestVolumeBootPattern-15540354',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:13:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-skg080bp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:13:59Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=29cf3139-d486-40da-8ab9-e695e5fd539b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "address": "fa:16:3e:1c:33:92", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aa2bb2-d6", "ovs_interfaceid": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "address": "fa:16:3e:1c:33:92", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7aa2bb2-d6", "ovs_interfaceid": "d7aa2bb2-d610-4a03-b5fc-be956243a668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:33:92,bridge_name='br-int',has_traffic_filtering=True,id=d7aa2bb2-d610-4a03-b5fc-be956243a668,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7aa2bb2-d6') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_vif [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:33:92,bridge_name='br-int',has_traffic_filtering=True,id=d7aa2bb2-d610-4a03-b5fc-be956243a668,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7aa2bb2-d6') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7aa2bb2-d6, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:41 user nova-compute[71516]: INFO os_vif [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:33:92,bridge_name='br-int',has_traffic_filtering=True,id=d7aa2bb2-d610-4a03-b5fc-be956243a668,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7aa2bb2-d6')
Apr 11 23:15:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaBHCpOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:15:41 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db1226c-385c-469c-a43b-c75f730811db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:15:41 user nova-compute[71516]: No targets found.
Apr 11 23:15:41 user nova-compute[71516]: iSNS:
Apr 11 23:15:41 user nova-compute[71516]: No targets found.
Apr 11 23:15:41 user nova-compute[71516]: STATIC:
Apr 11 23:15:41 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5
Apr 11 23:15:41 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:15:41 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:15:41 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd
Apr 11 23:15:41 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:15:41 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:15:41 user nova-compute[71516]: FIRMWARE:
Apr 11 23:15:41 user nova-compute[71516]: No targets found.
Apr 11 23:15:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:15:41 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:15:41 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d95aed-e835-4cdc-9162-7ec6c600b41b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcbb0be-120a-45e6-acf2-7e4989b49318]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:41 user nova-compute[71516]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:15:41 user nova-compute[71516]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:15:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e4c713400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd'): ({'sdd'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Removing single pathed devices sdd {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74e054e-402a-4492-9d40-a9c9ae7d11dc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4234923e-57a5-4621-ac56-8d6eb4c27e46]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flushing IO for device /dev/sdd {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f784a08-d314-464c-ad0c-11d57dc0bc81]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4009679-9e25-4a3f-93b0-a54241c0d063]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO66a65dec-f496bad6838fcaa0', '/dev/disk/by-id/scsi-26634393662616436', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_66a65dec') {{(pid=81691) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13bf45f-44e3-43c3-9ca1-dcb39487004d]: (4, None) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b05997-a284-4529-bf71-2182d11a49bb]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9ba131-c097-4781-89b3-38cb8cc4bd3c]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260]
Apr 11 23:15:42 user nova-compute[71516]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260] successful.
Apr 11 23:15:42 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[148ae67b-b0f8-4bac-a4de-95b6b0b30667]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== disconnect_volume: return (343ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:15:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Deleting instance files /opt/stack/data/nova/instances/29cf3139-d486-40da-8ab9-e695e5fd539b_del
Apr 11 23:15:42 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Deletion of /opt/stack/data/nova/instances/29cf3139-d486-40da-8ab9-e695e5fd539b_del complete
Apr 11 23:15:42 user nova-compute[71516]: INFO nova.compute.manager [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Took 1.24 seconds to destroy the instance on the hypervisor.
Apr 11 23:15:42 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:15:42 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Took 0.69 seconds to deallocate network for instance.
Apr 11 23:15:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-dbf94c13-a5ba-4c10-9302-46a912f33380 req-f7749df4-653c-48f0-8146-5439f6e982e2 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Received event network-vif-deleted-d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:42 user nova-compute[71516]: INFO nova.compute.manager [req-dbf94c13-a5ba-4c10-9302-46a912f33380 req-f7749df4-653c-48f0-8146-5439f6e982e2 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Neutron deleted interface d7aa2bb2-d610-4a03-b5fc-be956243a668; detaching it from the instance and deleting it from the info cache
Apr 11 23:15:42 user nova-compute[71516]: DEBUG nova.network.neutron [req-dbf94c13-a5ba-4c10-9302-46a912f33380 req-f7749df4-653c-48f0-8146-5439f6e982e2 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:15:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-dbf94c13-a5ba-4c10-9302-46a912f33380 req-f7749df4-653c-48f0-8146-5439f6e982e2 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Detach interface failed, port_id=d7aa2bb2-d610-4a03-b5fc-be956243a668, reason: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:15:43 user nova-compute[71516]: DEBUG nova.compute.manager [req-d42f427e-7400-4eca-a7f9-06ad79ea4e35 req-2eb95be3-1803-4864-aed7-bf85c2e2c667 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Received event network-vif-plugged-d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:15:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d42f427e-7400-4eca-a7f9-06ad79ea4e35 req-2eb95be3-1803-4864-aed7-bf85c2e2c667 service nova] Acquiring lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d42f427e-7400-4eca-a7f9-06ad79ea4e35 req-2eb95be3-1803-4864-aed7-bf85c2e2c667 service nova] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d42f427e-7400-4eca-a7f9-06ad79ea4e35 req-2eb95be3-1803-4864-aed7-bf85c2e2c667 service nova] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:43 user nova-compute[71516]: DEBUG nova.compute.manager [req-d42f427e-7400-4eca-a7f9-06ad79ea4e35 req-2eb95be3-1803-4864-aed7-bf85c2e2c667 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] No waiting events found dispatching network-vif-plugged-d7aa2bb2-d610-4a03-b5fc-be956243a668 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:15:43 user nova-compute[71516]: WARNING nova.compute.manager [req-d42f427e-7400-4eca-a7f9-06ad79ea4e35 req-2eb95be3-1803-4864-aed7-bf85c2e2c667 service nova] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Received unexpected event network-vif-plugged-d7aa2bb2-d610-4a03-b5fc-be956243a668 for instance with vm_state active and task_state deleting.
Apr 11 23:15:43 user nova-compute[71516]: INFO nova.compute.manager [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Took 0.79 seconds to detach 1 volumes for instance.
Apr 11 23:15:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:15:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:15:43 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Refreshing inventories for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 23:15:43 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Updating ProviderTree inventory for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 23:15:43 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Updating inventory in ProviderTree for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 23:15:43 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Refreshing aggregate associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, aggregates: None {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 23:15:43 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Refreshing trait associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 23:15:43 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:15:44 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:15:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:44 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Deleted allocations for instance 29cf3139-d486-40da-8ab9-e695e5fd539b
Apr 11 23:15:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "29cf3139-d486-40da-8ab9-e695e5fd539b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.289s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:15:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:56 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681254941.6442947, 29cf3139-d486-40da-8ab9-e695e5fd539b => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:15:56 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] VM Stopped (Lifecycle Event)
Apr 11 23:15:56 user nova-compute[71516]: DEBUG nova.compute.manager [None req-3d4c6e88-03a7-4f1a-9450-e0e7e1e758c5 None None] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:15:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:15:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:00 user nova-compute[71516]: INFO nova.compute.manager [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Unshelving
Apr 11 23:16:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:00 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'pci_requests' on Instance uuid fab7f71b-57f6-415b-9d2d-262a8ec6cb03 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:00 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'numa_topology' on Instance uuid fab7f71b-57f6-415b-9d2d-262a8ec6cb03 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:00 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:16:00 user nova-compute[71516]: INFO nova.compute.claims [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Claim successful on node user
Apr 11 23:16:00 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:16:00 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:16:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:00 user nova-compute[71516]: INFO nova.network.neutron [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Updating port 5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquired lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-changed-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Refreshing instance network info cache due to event network-changed-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] Acquiring lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Updating instance_info_cache with network_info: [{"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Releasing lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:16:01 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Creating image(s)
Apr 11 23:16:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "/opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "/opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "/opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'trusted_certs' on Instance uuid fab7f71b-57f6-415b-9d2d-262a8ec6cb03 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] Acquired lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG nova.network.neutron [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Refreshing network info cache for port 5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "986ed538b28109bf7e19dcbc4540fc9b665cda7c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "986ed538b28109bf7e19dcbc4540fc9b665cda7c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c.part --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c.part --force-share --output=json" returned: 0 in 0.158s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:02 user nova-compute[71516]: DEBUG nova.virt.images [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 33687ef1-a0b8-497f-ad63-b52558ba5afc was qcow2, converting to raw {{(pid=71516) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 23:16:02 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:16:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c.part /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c.converted {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG nova.network.neutron [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Updated VIF entry in instance network info cache for port 5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG nova.network.neutron [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Updating instance_info_cache with network_info: [{"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] Releasing lock "refresh_cache-fab7f71b-57f6-415b-9d2d-262a8ec6cb03" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c.part /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c.converted" returned: 0 in 0.471s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c.converted --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "986ed538b28109bf7e19dcbc4540fc9b665cda7c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.691s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "986ed538b28109bf7e19dcbc4540fc9b665cda7c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "986ed538b28109bf7e19dcbc4540fc9b665cda7c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c,backing_fmt=raw /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c,backing_fmt=raw /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk 1073741824" returned: 0 in 0.056s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "986ed538b28109bf7e19dcbc4540fc9b665cda7c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:04 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'migration_context' on Instance uuid fab7f71b-57f6-415b-9d2d-262a8ec6cb03 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:04 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Rebasing disk image.
Apr 11 23:16:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 -F raw /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 -F raw /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk" returned: 0 in 2.025s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Ensure instance console log exists: /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Start _get_guest_xml network_info=[{"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ca85f10ed8c4ad39448a0ea197c2bb35',container_format='bare',created_at=2023-04-11T23:14:08Z,direct_url=<?>,disk_format='qcow2',id=33687ef1-a0b8-497f-ad63-b52558ba5afc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1536485804-shelved',owner='b466a7e141a247319eae64ab30aca760',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T23:14:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:16:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:16:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ca85f10ed8c4ad39448a0ea197c2bb35',container_format='bare',created_at=2023-04-11T23:14:08Z,direct_url=<?>,disk_format='qcow2',id=33687ef1-a0b8-497f-ad63-b52558ba5afc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1536485804-shelved',owner='b466a7e141a247319eae64ab30aca760',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T23:14:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'vcpu_model' on Instance uuid fab7f71b-57f6-415b-9d2d-262a8ec6cb03 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1536485804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1536485804',id=21,image_ref='33687ef1-a0b8-497f-ad63-b52558ba5afc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-865048007',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b466a7e141a247319eae64ab30aca760',ramdisk_id='',reservation_id='r-05tlqmg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849897654',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849897654-project-member',shelved_at='2023-04-11T23:14:11.236038',shelved_host='user',shelved_image_id='33687ef1-a0b8-497f-ad63-b52558ba5afc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7272af33be864737b2231127f4323638',uuid=fab7f71b-57f6-415b-9d2d-262a8ec6cb03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converting VIF {"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'pci_devices' on Instance uuid fab7f71b-57f6-415b-9d2d-262a8ec6cb03 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:16:06 user nova-compute[71516]:   <uuid>fab7f71b-57f6-415b-9d2d-262a8ec6cb03</uuid>
Apr 11 23:16:06 user nova-compute[71516]:   <name>instance-00000015</name>
Apr 11 23:16:06 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:16:06 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:16:06 user nova-compute[71516]:   <metadata>
Apr 11 23:16:06 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:16:06 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:16:06 user nova-compute[71516]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1536485804</nova:name>
Apr 11 23:16:06 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:16:06</nova:creationTime>
Apr 11 23:16:06 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:16:06 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:16:06 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:16:06 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:16:06 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:16:06 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:16:06 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:16:06 user nova-compute[71516]:       <nova:owner>
Apr 11 23:16:06 user nova-compute[71516]:         <nova:user uuid="7272af33be864737b2231127f4323638">tempest-AttachVolumeShelveTestJSON-1849897654-project-member</nova:user>
Apr 11 23:16:06 user nova-compute[71516]:         <nova:project uuid="b466a7e141a247319eae64ab30aca760">tempest-AttachVolumeShelveTestJSON-1849897654</nova:project>
Apr 11 23:16:06 user nova-compute[71516]:       </nova:owner>
Apr 11 23:16:06 user nova-compute[71516]:       <nova:root type="image" uuid="33687ef1-a0b8-497f-ad63-b52558ba5afc"/>
Apr 11 23:16:06 user nova-compute[71516]:       <nova:ports>
Apr 11 23:16:06 user nova-compute[71516]:         <nova:port uuid="5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a">
Apr 11 23:16:06 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 23:16:06 user nova-compute[71516]:         </nova:port>
Apr 11 23:16:06 user nova-compute[71516]:       </nova:ports>
Apr 11 23:16:06 user nova-compute[71516]:     </nova:instance>
Apr 11 23:16:06 user nova-compute[71516]:   </metadata>
Apr 11 23:16:06 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:16:06 user nova-compute[71516]:     <system>
Apr 11 23:16:06 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:16:06 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:16:06 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:16:06 user nova-compute[71516]:       <entry name="serial">fab7f71b-57f6-415b-9d2d-262a8ec6cb03</entry>
Apr 11 23:16:06 user nova-compute[71516]:       <entry name="uuid">fab7f71b-57f6-415b-9d2d-262a8ec6cb03</entry>
Apr 11 23:16:06 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:16:06 user nova-compute[71516]:     </system>
Apr 11 23:16:06 user nova-compute[71516]:   </sysinfo>
Apr 11 23:16:06 user nova-compute[71516]:   <os>
Apr 11 23:16:06 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:16:06 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:16:06 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:16:06 user nova-compute[71516]:   </os>
Apr 11 23:16:06 user nova-compute[71516]:   <features>
Apr 11 23:16:06 user nova-compute[71516]:     <acpi/>
Apr 11 23:16:06 user nova-compute[71516]:     <apic/>
Apr 11 23:16:06 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:16:06 user nova-compute[71516]:   </features>
Apr 11 23:16:06 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:16:06 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:16:06 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:16:06 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:16:06 user nova-compute[71516]:   </clock>
Apr 11 23:16:06 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:16:06 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:16:06 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:16:06 user nova-compute[71516]:   </cpu>
Apr 11 23:16:06 user nova-compute[71516]:   <devices>
Apr 11 23:16:06 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:16:06 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:16:06 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk"/>
Apr 11 23:16:06 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:16:06 user nova-compute[71516]:     </disk>
Apr 11 23:16:06 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:16:06 user nova-compute[71516]:       <mac address="fa:16:3e:e7:9e:95"/>
Apr 11 23:16:06 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:16:06 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:16:06 user nova-compute[71516]:       <target dev="tap5f6c4dd1-5b"/>
Apr 11 23:16:06 user nova-compute[71516]:     </interface>
Apr 11 23:16:06 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:16:06 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/console.log" append="off"/>
Apr 11 23:16:06 user nova-compute[71516]:     </serial>
Apr 11 23:16:06 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:16:06 user nova-compute[71516]:     <video>
Apr 11 23:16:06 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:16:06 user nova-compute[71516]:     </video>
Apr 11 23:16:06 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:16:06 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:16:06 user nova-compute[71516]:     </rng>
Apr 11 23:16:06 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:16:06 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:16:06 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:16:06 user nova-compute[71516]:     </memballoon>
Apr 11 23:16:06 user nova-compute[71516]:   </devices>
Apr 11 23:16:06 user nova-compute[71516]: </domain>
Apr 11 23:16:06 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1536485804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1536485804',id=21,image_ref='33687ef1-a0b8-497f-ad63-b52558ba5afc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-865048007',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b466a7e141a247319eae64ab30aca760',ramdisk_id='',reservation_id='r-05tlqmg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849897654',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849897654-project-member',shelved_at='2023-04-11T23:14:11.236038',shelved_host='user',shelved_image_id='33687ef1-a0b8-497f-ad63-b52558ba5afc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7272af33be864737b2231127f4323638',uuid=fab7f71b-57f6-415b-9d2d-262a8ec6cb03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converting VIF {"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG os_vif [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f6c4dd1-5b, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f6c4dd1-5b, col_values=(('external_ids', {'iface-id': '5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:9e:95', 'vm-uuid': 'fab7f71b-57f6-415b-9d2d-262a8ec6cb03'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:06 user nova-compute[71516]: INFO os_vif [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b')
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:16:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] No VIF found with MAC fa:16:3e:e7:9e:95, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:16:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-d69b82c3-e587-49b5-98ca-e29b36e67361 req-89e9d150-62e4-475e-a5b7-c7bdc6edfe03 service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d69b82c3-e587-49b5-98ca-e29b36e67361 req-89e9d150-62e4-475e-a5b7-c7bdc6edfe03 service nova] Acquiring lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d69b82c3-e587-49b5-98ca-e29b36e67361 req-89e9d150-62e4-475e-a5b7-c7bdc6edfe03 service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d69b82c3-e587-49b5-98ca-e29b36e67361 req-89e9d150-62e4-475e-a5b7-c7bdc6edfe03 service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-d69b82c3-e587-49b5-98ca-e29b36e67361 req-89e9d150-62e4-475e-a5b7-c7bdc6edfe03 service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] No waiting events found dispatching network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:16:08 user nova-compute[71516]: WARNING nova.compute.manager [req-d69b82c3-e587-49b5-98ca-e29b36e67361 req-89e9d150-62e4-475e-a5b7-c7bdc6edfe03 service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received unexpected event network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 23:16:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:16:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:09 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:16:09 user nova-compute[71516]: INFO nova.compute.claims [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Claim successful on node user
Apr 11 23:16:09 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:16:09 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:16:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:16:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:16:10 user nova-compute[71516]: INFO nova.virt.block_device [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Booting with volume 1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 at /dev/vda
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.policy [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acfb7fc33f4e4694bcc224292ac5f231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3252362661dd4f8c9ad6298048a84c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG os_brick.utils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e17d1d-f2e1-4cdc-b45d-978bc816ad37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-efdd7c8c-3d84-4236-8e61-34b665ebb1d5 req-aa75bb58-3e59-4418-8f46-b0c39ab74f2d service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-efdd7c8c-3d84-4236-8e61-34b665ebb1d5 req-aa75bb58-3e59-4418-8f46-b0c39ab74f2d service nova] Acquiring lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-efdd7c8c-3d84-4236-8e61-34b665ebb1d5 req-aa75bb58-3e59-4418-8f46-b0c39ab74f2d service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-efdd7c8c-3d84-4236-8e61-34b665ebb1d5 req-aa75bb58-3e59-4418-8f46-b0c39ab74f2d service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-efdd7c8c-3d84-4236-8e61-34b665ebb1d5 req-aa75bb58-3e59-4418-8f46-b0c39ab74f2d service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] No waiting events found dispatching network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:16:10 user nova-compute[71516]: WARNING nova.compute.manager [req-efdd7c8c-3d84-4236-8e61-34b665ebb1d5 req-aa75bb58-3e59-4418-8f46-b0c39ab74f2d service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received unexpected event network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[787bdbfe-7642-44a0-b526-477c57ac6eea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254970.2238848, fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:16:10 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] VM Resumed (Lifecycle Event)
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fef18c-b3e9-4fbc-8bd7-48851669c792]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c8025c-05ca-4af5-b7ed-c46bdf8b69b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Instance spawned successfully.
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:16:10 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[43747839-d7a8-4663-9e56-3bd8e97dd347]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG os_brick.utils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updating existing volume attachment record: db6b2315-6ddf-48a2-a3f4-458248860d94 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:16:10 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254970.2262242, fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:16:10 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] VM Started (Lifecycle Event)
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:16:10 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.454s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:10 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Successfully created port: 5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:16:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:11 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Successfully updated port: 5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:16:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:16:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquired lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:16:11 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:16:11 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:16:12 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updating instance_info_cache with network_info: [{"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:16:12 user nova-compute[71516]: DEBUG nova.compute.manager [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-changed-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:12 user nova-compute[71516]: DEBUG nova.compute.manager [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Refreshing instance network info cache due to event network-changed-5bd8ff97-1370-4a98-8111-ac1c6635a9ee. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:16:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] Acquiring lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:16:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Releasing lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:16:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Instance network_info: |[{"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:16:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] Acquired lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:16:12 user nova-compute[71516]: DEBUG nova.network.neutron [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Refreshing network info cache for port 5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:16:13 user nova-compute[71516]: DEBUG nova.network.neutron [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updated VIF entry in instance network info cache for port 5bd8ff97-1370-4a98-8111-ac1c6635a9ee. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:16:13 user nova-compute[71516]: DEBUG nova.network.neutron [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updating instance_info_cache with network_info: [{"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:16:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] Releasing lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:16:14 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Creating image(s)
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Ensure instance console log exists: /opt/stack/data/nova/instances/8d9f6a0d-caab-4f42-a9b1-a4653b90559f/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Start _get_guest_xml network_info=[{"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePzEAZJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d9f6a0d-caab-4f42-a9b1-a4653b90559f', 'attached_at': '', 'detached_at': '', 'volume_id': '1ba1bebe-9c96-4eb9-813a-593d2a5a4d94', 'serial': '1ba1bebe-9c96-4eb9-813a-593d2a5a4d94'}, 'disk_bus': 'virtio', 'attachment_id': 'db6b2315-6ddf-48a2-a3f4-458248860d94', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:16:14 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:16:14 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePzEAZJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:16:14 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:16:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:16:14 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:16:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:16:14 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:16:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2643ef3-87da-4ef2-b90f-b8685732cfe4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:16:14 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3921d33c-d670-4f33-abbd-7cd01f0f9824]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94] added
Apr 11 23:16:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dbb0f0-3020-46c1-a3ad-dc095ce3b96d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0629214-5aac-492b-b61e-89e3515b8a8d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePzEAZJp {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePzEAZJp" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8708aba0-2790-44c6-bc88-512c4e938b78]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ePzEAZJp'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2371afd-f7c4-4d57-bcb3-82eed9b1a9ac]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[616b0857-eee8-4f33-aa57-3d0c6d60abe7]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:16:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:16:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4ad20d-3b3d-4328-a1fb-c2393f19e60e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260]
Apr 11 23:16:15 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260] successful.
Apr 11 23:16:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ecadb0-fe2f-4e25-8f84-148ea73b6eed]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dd7155-adbb-4ca2-96fc-bc215c859a71]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:16:15 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:16:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:16:15 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:16:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[06553cf6-e7aa-4096-9d06-922b0e77f4ab]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:16:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePzEAZJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26238336437363632', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238336437363632', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1643016946',display_name='tempest-TestShelveInstance-server-1643016946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1643016946',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgAA/M8o66n0P5gxuVKww0/BCxA0rUaiV6ohdeuypE0j3Kmiiiuava13qXCYccyFsmSc/AuIKI2xHRcKEGO3MwIJuyx6Z95uIU1juqzY2j0pbX2+qlSqsiVm9Z0Pwdf/A==',key_name='tempest-TestShelveInstance-1561116455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3252362661dd4f8c9ad6298048a84c6a',ramdisk_id='',reservation_id='r-k4wk8wut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-932398179',owner_user_name='tempest-TestShelveInstance-932398179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:16:10Z,user_data=None,user_id='acfb7fc33f4e4694bcc224292ac5f231',uuid=8d9f6a0d-caab-4f42-a9b1-a4653b90559f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Converting VIF {"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d9f6a0d-caab-4f42-a9b1-a4653b90559f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:16:16 user nova-compute[71516]:   <uuid>8d9f6a0d-caab-4f42-a9b1-a4653b90559f</uuid>
Apr 11 23:16:16 user nova-compute[71516]:   <name>instance-0000001c</name>
Apr 11 23:16:16 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:16:16 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:16:16 user nova-compute[71516]:   <metadata>
Apr 11 23:16:16 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:16:16 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:16:16 user nova-compute[71516]:       <nova:name>tempest-TestShelveInstance-server-1643016946</nova:name>
Apr 11 23:16:16 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:16:14</nova:creationTime>
Apr 11 23:16:16 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:16:16 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:16:16 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:16:16 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:16:16 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:16:16 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:16:16 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:16:16 user nova-compute[71516]:       <nova:owner>
Apr 11 23:16:16 user nova-compute[71516]:         <nova:user uuid="acfb7fc33f4e4694bcc224292ac5f231">tempest-TestShelveInstance-932398179-project-member</nova:user>
Apr 11 23:16:16 user nova-compute[71516]:         <nova:project uuid="3252362661dd4f8c9ad6298048a84c6a">tempest-TestShelveInstance-932398179</nova:project>
Apr 11 23:16:16 user nova-compute[71516]:       </nova:owner>
Apr 11 23:16:16 user nova-compute[71516]:       <nova:ports>
Apr 11 23:16:16 user nova-compute[71516]:         <nova:port uuid="5bd8ff97-1370-4a98-8111-ac1c6635a9ee">
Apr 11 23:16:16 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 23:16:16 user nova-compute[71516]:         </nova:port>
Apr 11 23:16:16 user nova-compute[71516]:       </nova:ports>
Apr 11 23:16:16 user nova-compute[71516]:     </nova:instance>
Apr 11 23:16:16 user nova-compute[71516]:   </metadata>
Apr 11 23:16:16 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:16:16 user nova-compute[71516]:     <system>
Apr 11 23:16:16 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:16:16 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:16:16 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:16:16 user nova-compute[71516]:       <entry name="serial">8d9f6a0d-caab-4f42-a9b1-a4653b90559f</entry>
Apr 11 23:16:16 user nova-compute[71516]:       <entry name="uuid">8d9f6a0d-caab-4f42-a9b1-a4653b90559f</entry>
Apr 11 23:16:16 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:16:16 user nova-compute[71516]:     </system>
Apr 11 23:16:16 user nova-compute[71516]:   </sysinfo>
Apr 11 23:16:16 user nova-compute[71516]:   <os>
Apr 11 23:16:16 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:16:16 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:16:16 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:16:16 user nova-compute[71516]:   </os>
Apr 11 23:16:16 user nova-compute[71516]:   <features>
Apr 11 23:16:16 user nova-compute[71516]:     <acpi/>
Apr 11 23:16:16 user nova-compute[71516]:     <apic/>
Apr 11 23:16:16 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:16:16 user nova-compute[71516]:   </features>
Apr 11 23:16:16 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:16:16 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:16:16 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:16:16 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:16:16 user nova-compute[71516]:   </clock>
Apr 11 23:16:16 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:16:16 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:16:16 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:16:16 user nova-compute[71516]:   </cpu>
Apr 11 23:16:16 user nova-compute[71516]:   <devices>
Apr 11 23:16:16 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:16:16 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:16:16 user nova-compute[71516]:       <source dev="/dev/sdc"/>
Apr 11 23:16:16 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:16:16 user nova-compute[71516]:       <serial>1ba1bebe-9c96-4eb9-813a-593d2a5a4d94</serial>
Apr 11 23:16:16 user nova-compute[71516]:     </disk>
Apr 11 23:16:16 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:16:16 user nova-compute[71516]:       <mac address="fa:16:3e:59:76:73"/>
Apr 11 23:16:16 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:16:16 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:16:16 user nova-compute[71516]:       <target dev="tap5bd8ff97-13"/>
Apr 11 23:16:16 user nova-compute[71516]:     </interface>
Apr 11 23:16:16 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:16:16 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/8d9f6a0d-caab-4f42-a9b1-a4653b90559f/console.log" append="off"/>
Apr 11 23:16:16 user nova-compute[71516]:     </serial>
Apr 11 23:16:16 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:16:16 user nova-compute[71516]:     <video>
Apr 11 23:16:16 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:16:16 user nova-compute[71516]:     </video>
Apr 11 23:16:16 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:16:16 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:16:16 user nova-compute[71516]:     </rng>
Apr 11 23:16:16 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:16:16 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:16:16 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:16:16 user nova-compute[71516]:     </memballoon>
Apr 11 23:16:16 user nova-compute[71516]:   </devices>
Apr 11 23:16:16 user nova-compute[71516]: </domain>
Apr 11 23:16:16 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1643016946',display_name='tempest-TestShelveInstance-server-1643016946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1643016946',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgAA/M8o66n0P5gxuVKww0/BCxA0rUaiV6ohdeuypE0j3Kmiiiuava13qXCYccyFsmSc/AuIKI2xHRcKEGO3MwIJuyx6Z95uIU1juqzY2j0pbX2+qlSqsiVm9Z0Pwdf/A==',key_name='tempest-TestShelveInstance-1561116455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3252362661dd4f8c9ad6298048a84c6a',ramdisk_id='',reservation_id='r-k4wk8wut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-932398179',owner_user_name='tempest-TestShelveInstance-932398179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:16:10Z,user_data=None,user_id='acfb7fc33f4e4694bcc224292ac5f231',uuid=8d9f6a0d-caab-4f42-a9b1-a4653b90559f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Converting VIF {"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG os_vif [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bd8ff97-13, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5bd8ff97-13, col_values=(('external_ids', {'iface-id': '5bd8ff97-1370-4a98-8111-ac1c6635a9ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:76:73', 'vm-uuid': '8d9f6a0d-caab-4f42-a9b1-a4653b90559f'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:16 user nova-compute[71516]: INFO os_vif [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13')
Apr 11 23:16:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:16:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] No VIF found with MAC fa:16:3e:59:76:73, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:16:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-679d7b80-fe53-4a44-b7b4-aea9d2a4e8d7 req-69f956ce-7b7f-430b-af5f-8408d6bcf51d service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-679d7b80-fe53-4a44-b7b4-aea9d2a4e8d7 req-69f956ce-7b7f-430b-af5f-8408d6bcf51d service nova] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-679d7b80-fe53-4a44-b7b4-aea9d2a4e8d7 req-69f956ce-7b7f-430b-af5f-8408d6bcf51d service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-679d7b80-fe53-4a44-b7b4-aea9d2a4e8d7 req-69f956ce-7b7f-430b-af5f-8408d6bcf51d service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-679d7b80-fe53-4a44-b7b4-aea9d2a4e8d7 req-69f956ce-7b7f-430b-af5f-8408d6bcf51d service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] No waiting events found dispatching network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:16:17 user nova-compute[71516]: WARNING nova.compute.manager [req-679d7b80-fe53-4a44-b7b4-aea9d2a4e8d7 req-69f956ce-7b7f-430b-af5f-8408d6bcf51d service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received unexpected event network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance with vm_state building and task_state spawning.
Apr 11 23:16:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254979.8202245, 8d9f6a0d-caab-4f42-a9b1-a4653b90559f => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:16:19 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] VM Resumed (Lifecycle Event)
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:16:19 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Instance spawned successfully.
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:19 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254979.8208337, 8d9f6a0d-caab-4f42-a9b1-a4653b90559f => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:16:19 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] VM Started (Lifecycle Event)
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.compute.manager [req-c5ac6360-1f31-427a-8e78-97b6be68d390 req-64c5f6ff-b3b7-464f-a9c7-f4db3f4cd2e6 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c5ac6360-1f31-427a-8e78-97b6be68d390 req-64c5f6ff-b3b7-464f-a9c7-f4db3f4cd2e6 service nova] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c5ac6360-1f31-427a-8e78-97b6be68d390 req-64c5f6ff-b3b7-464f-a9c7-f4db3f4cd2e6 service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c5ac6360-1f31-427a-8e78-97b6be68d390 req-64c5f6ff-b3b7-464f-a9c7-f4db3f4cd2e6 service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.compute.manager [req-c5ac6360-1f31-427a-8e78-97b6be68d390 req-64c5f6ff-b3b7-464f-a9c7-f4db3f4cd2e6 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] No waiting events found dispatching network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:16:19 user nova-compute[71516]: WARNING nova.compute.manager [req-c5ac6360-1f31-427a-8e78-97b6be68d390 req-64c5f6ff-b3b7-464f-a9c7-f4db3f4cd2e6 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received unexpected event network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance with vm_state building and task_state spawning.
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:16:19 user nova-compute[71516]: INFO nova.compute.manager [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Took 5.02 seconds to spawn the instance on the hypervisor.
Apr 11 23:16:19 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:19 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:16:20 user nova-compute[71516]: INFO nova.compute.manager [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Took 10.49 seconds to build instance.
Apr 11 23:16:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.590s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG nova.objects.instance [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'flavor' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquired lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG nova.network.neutron [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG nova.objects.instance [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'info_cache' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG nova.network.neutron [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Updating instance_info_cache with network_info: [{"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Releasing lock "refresh_cache-e4d31874-4273-48bc-8811-89832d18b893" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:16:25 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] Instance destroyed successfully.
Apr 11 23:16:25 user nova-compute[71516]: DEBUG nova.objects.instance [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'resources' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-306537180',display_name='tempest-AttachVolumeTestJSON-server-306537180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-306537180',id=16,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBCZV7mfgey8l84oWxyLPmpf/vUdIecbJfbZusGcLaLsUyVaAO/eUu8uumuNjaCqYf3u0A6YOPq2RC4XZqaH6cL8LKWE4mILFzbc1EBe4QFoOM0qAj4Mr6qKrIzOcb4DQ==',key_name='tempest-keypair-759307061',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f0ff3d48596a44f8ac8d9306becd8178',ramdisk_id='',reservation_id='r-75uy56ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-343820803',owner_user_name='tempest-AttachVolumeTestJSON-343820803-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1793cec543e8425899474614b2c10f5d',uuid=e4d31874-4273-48bc-8811-89832d18b893,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converting VIF {"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG os_vif [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac90e400-80, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:16:26 user nova-compute[71516]: INFO os_vif [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80')
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Start _get_guest_xml network_info=[{"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.objects.instance [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'numa_topology' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:26 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:16:26 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.objects.instance [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-306537180',display_name='tempest-AttachVolumeTestJSON-server-306537180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-306537180',id=16,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBCZV7mfgey8l84oWxyLPmpf/vUdIecbJfbZusGcLaLsUyVaAO/eUu8uumuNjaCqYf3u0A6YOPq2RC4XZqaH6cL8LKWE4mILFzbc1EBe4QFoOM0qAj4Mr6qKrIzOcb4DQ==',key_name='tempest-keypair-759307061',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f0ff3d48596a44f8ac8d9306becd8178',ramdisk_id='',reservation_id='r-75uy56ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-343820803',owner_user_name='tempest-AttachVolumeTestJSON-343820803-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1793cec543e8425899474614b2c10f5d',uuid=e4d31874-4273-48bc-8811-89832d18b893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converting VIF {"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.objects.instance [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'pci_devices' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:16:26 user nova-compute[71516]:   <uuid>e4d31874-4273-48bc-8811-89832d18b893</uuid>
Apr 11 23:16:26 user nova-compute[71516]:   <name>instance-00000010</name>
Apr 11 23:16:26 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:16:26 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:16:26 user nova-compute[71516]:   <metadata>
Apr 11 23:16:26 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:16:26 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:16:26 user nova-compute[71516]:       <nova:name>tempest-AttachVolumeTestJSON-server-306537180</nova:name>
Apr 11 23:16:26 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:16:26</nova:creationTime>
Apr 11 23:16:26 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:16:26 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:16:26 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:16:26 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:16:26 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:16:26 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:16:26 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:16:26 user nova-compute[71516]:       <nova:owner>
Apr 11 23:16:26 user nova-compute[71516]:         <nova:user uuid="1793cec543e8425899474614b2c10f5d">tempest-AttachVolumeTestJSON-343820803-project-member</nova:user>
Apr 11 23:16:26 user nova-compute[71516]:         <nova:project uuid="f0ff3d48596a44f8ac8d9306becd8178">tempest-AttachVolumeTestJSON-343820803</nova:project>
Apr 11 23:16:26 user nova-compute[71516]:       </nova:owner>
Apr 11 23:16:26 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:16:26 user nova-compute[71516]:       <nova:ports>
Apr 11 23:16:26 user nova-compute[71516]:         <nova:port uuid="ac90e400-803b-41b5-b183-f93bfbf297b6">
Apr 11 23:16:26 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 23:16:26 user nova-compute[71516]:         </nova:port>
Apr 11 23:16:26 user nova-compute[71516]:       </nova:ports>
Apr 11 23:16:26 user nova-compute[71516]:     </nova:instance>
Apr 11 23:16:26 user nova-compute[71516]:   </metadata>
Apr 11 23:16:26 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:16:26 user nova-compute[71516]:     <system>
Apr 11 23:16:26 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:16:26 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:16:26 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:16:26 user nova-compute[71516]:       <entry name="serial">e4d31874-4273-48bc-8811-89832d18b893</entry>
Apr 11 23:16:26 user nova-compute[71516]:       <entry name="uuid">e4d31874-4273-48bc-8811-89832d18b893</entry>
Apr 11 23:16:26 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:16:26 user nova-compute[71516]:     </system>
Apr 11 23:16:26 user nova-compute[71516]:   </sysinfo>
Apr 11 23:16:26 user nova-compute[71516]:   <os>
Apr 11 23:16:26 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:16:26 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:16:26 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:16:26 user nova-compute[71516]:   </os>
Apr 11 23:16:26 user nova-compute[71516]:   <features>
Apr 11 23:16:26 user nova-compute[71516]:     <acpi/>
Apr 11 23:16:26 user nova-compute[71516]:     <apic/>
Apr 11 23:16:26 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:16:26 user nova-compute[71516]:   </features>
Apr 11 23:16:26 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:16:26 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:16:26 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:16:26 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:16:26 user nova-compute[71516]:   </clock>
Apr 11 23:16:26 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:16:26 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:16:26 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:16:26 user nova-compute[71516]:   </cpu>
Apr 11 23:16:26 user nova-compute[71516]:   <devices>
Apr 11 23:16:26 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:16:26 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:16:26 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk"/>
Apr 11 23:16:26 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:16:26 user nova-compute[71516]:     </disk>
Apr 11 23:16:26 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:16:26 user nova-compute[71516]:       <mac address="fa:16:3e:f7:1e:78"/>
Apr 11 23:16:26 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:16:26 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:16:26 user nova-compute[71516]:       <target dev="tapac90e400-80"/>
Apr 11 23:16:26 user nova-compute[71516]:     </interface>
Apr 11 23:16:26 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:16:26 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/console.log" append="off"/>
Apr 11 23:16:26 user nova-compute[71516]:     </serial>
Apr 11 23:16:26 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:16:26 user nova-compute[71516]:     <video>
Apr 11 23:16:26 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:16:26 user nova-compute[71516]:     </video>
Apr 11 23:16:26 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:16:26 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:16:26 user nova-compute[71516]:     </rng>
Apr 11 23:16:26 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:16:26 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:16:26 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:16:26 user nova-compute[71516]:     </memballoon>
Apr 11 23:16:26 user nova-compute[71516]:   </devices>
Apr 11 23:16:26 user nova-compute[71516]: </domain>
Apr 11 23:16:26 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.objects.instance [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'trusted_certs' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Cannot resize image /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.objects.instance [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'migration_context' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-306537180',display_name='tempest-AttachVolumeTestJSON-server-306537180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-306537180',id=16,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBCZV7mfgey8l84oWxyLPmpf/vUdIecbJfbZusGcLaLsUyVaAO/eUu8uumuNjaCqYf3u0A6YOPq2RC4XZqaH6cL8LKWE4mILFzbc1EBe4QFoOM0qAj4Mr6qKrIzOcb4DQ==',key_name='tempest-keypair-759307061',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f0ff3d48596a44f8ac8d9306becd8178',ramdisk_id='',reservation_id='r-75uy56ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-343820803',owner_user_name='tempest-AttachVolumeTestJSON-343820803-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1793cec543e8425899474614b2c10f5d',uuid=e4d31874-4273-48bc-8811-89832d18b893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converting VIF {"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG os_vif [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac90e400-80, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac90e400-80, col_values=(('external_ids', {'iface-id': 'ac90e400-803b-41b5-b183-f93bfbf297b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:1e:78', 'vm-uuid': 'e4d31874-4273-48bc-8811-89832d18b893'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:16:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:26 user nova-compute[71516]: INFO os_vif [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80')
Apr 11 23:16:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:16:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-625c7743-8ff3-4a0b-aedd-82532babfc18 req-688e6b35-06f0-4844-bd92-cda0b16b788e service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-625c7743-8ff3-4a0b-aedd-82532babfc18 req-688e6b35-06f0-4844-bd92-cda0b16b788e service nova] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-625c7743-8ff3-4a0b-aedd-82532babfc18 req-688e6b35-06f0-4844-bd92-cda0b16b788e service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-625c7743-8ff3-4a0b-aedd-82532babfc18 req-688e6b35-06f0-4844-bd92-cda0b16b788e service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-625c7743-8ff3-4a0b-aedd-82532babfc18 req-688e6b35-06f0-4844-bd92-cda0b16b788e service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] No waiting events found dispatching network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:16:28 user nova-compute[71516]: WARNING nova.compute.manager [req-625c7743-8ff3-4a0b-aedd-82532babfc18 req-688e6b35-06f0-4844-bd92-cda0b16b788e service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received unexpected event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 for instance with vm_state stopped and task_state powering-on.
Apr 11 23:16:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254990.532576, e4d31874-4273-48bc-8811-89832d18b893 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:16:30 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] VM Resumed (Lifecycle Event)
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:30 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] Instance rebooted successfully.
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:16:30 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681254990.537413, e4d31874-4273-48bc-8811-89832d18b893 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:16:30 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] VM Started (Lifecycle Event)
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.compute.manager [req-917235df-775d-4530-9e76-c7d1a5dd2bab req-34fc17bc-4ca1-455a-94ce-9ba84a6e7186 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917235df-775d-4530-9e76-c7d1a5dd2bab req-34fc17bc-4ca1-455a-94ce-9ba84a6e7186 service nova] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917235df-775d-4530-9e76-c7d1a5dd2bab req-34fc17bc-4ca1-455a-94ce-9ba84a6e7186 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-917235df-775d-4530-9e76-c7d1a5dd2bab req-34fc17bc-4ca1-455a-94ce-9ba84a6e7186 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG nova.compute.manager [req-917235df-775d-4530-9e76-c7d1a5dd2bab req-34fc17bc-4ca1-455a-94ce-9ba84a6e7186 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] No waiting events found dispatching network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:16:30 user nova-compute[71516]: WARNING nova.compute.manager [req-917235df-775d-4530-9e76-c7d1a5dd2bab req-34fc17bc-4ca1-455a-94ce-9ba84a6e7186 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received unexpected event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 for instance with vm_state active and task_state None.
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:33 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:16:33 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=7999MB free_disk=26.284622192382812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e4d31874-4273-48bc-8811-89832d18b893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:16:33 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.355s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:16:34 user nova-compute[71516]: INFO nova.compute.claims [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Claim successful on node user
Apr 11 23:16:34 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:16:34 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:16:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:16:34 user nova-compute[71516]: INFO nova.virt.block_device [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Booting with volume 6170821e-16c7-4cae-a138-dbac84aea6cd at /dev/vda
Apr 11 23:16:34 user nova-compute[71516]: DEBUG os_brick.utils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0879d885-2d40-4905-b03a-91865727005d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG nova.policy [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[58046fb0-055a-410a-ba13-878f5818e740]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cc42d0-4afe-462c-ab6e-982d60a6ecd2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa66eb6-6926-4e1a-ad42-62ec22bd9eed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:16:34 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:16:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6add15-bdab-4e5e-a5cc-9ac531e9a9f8]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG os_brick.utils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:16:34 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Updating existing volume attachment record: 5f97c706-b4e5-439e-bee8-683450571779 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:16:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Successfully created port: 251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:16:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Successfully updated port: 251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "refresh_cache-f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquired lock "refresh_cache-f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Received event network-changed-251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Refreshing instance network info cache due to event network-changed-251c2317-e6a3-40d8-849b-bec8357be943. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] Acquiring lock "refresh_cache-f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Updating instance_info_cache with network_info: [{"id": "251c2317-e6a3-40d8-849b-bec8357be943", "address": "fa:16:3e:c4:c9:7b", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251c2317-e6", "ovs_interfaceid": "251c2317-e6a3-40d8-849b-bec8357be943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Releasing lock "refresh_cache-f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Instance network_info: |[{"id": "251c2317-e6a3-40d8-849b-bec8357be943", "address": "fa:16:3e:c4:c9:7b", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251c2317-e6", "ovs_interfaceid": "251c2317-e6a3-40d8-849b-bec8357be943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] Acquired lock "refresh_cache-f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:16:37 user nova-compute[71516]: DEBUG nova.network.neutron [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Refreshing network info cache for port 251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:16:38 user nova-compute[71516]: DEBUG nova.network.neutron [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Updated VIF entry in instance network info cache for port 251c2317-e6a3-40d8-849b-bec8357be943. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:16:38 user nova-compute[71516]: DEBUG nova.network.neutron [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Updating instance_info_cache with network_info: [{"id": "251c2317-e6a3-40d8-849b-bec8357be943", "address": "fa:16:3e:c4:c9:7b", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251c2317-e6", "ovs_interfaceid": "251c2317-e6a3-40d8-849b-bec8357be943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:16:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] Releasing lock "refresh_cache-f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:16:39 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Creating image(s)
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Ensure instance console log exists: /opt/stack/data/nova/instances/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Start _get_guest_xml network_info=[{"id": "251c2317-e6a3-40d8-849b-bec8357be943", "address": "fa:16:3e:c4:c9:7b", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251c2317-e6", "ovs_interfaceid": "251c2317-e6a3-40d8-849b-bec8357be943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaBHCpOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f', 'attached_at': '', 'detached_at': '', 'volume_id': '6170821e-16c7-4cae-a138-dbac84aea6cd', 'serial': '6170821e-16c7-4cae-a138-dbac84aea6cd'}, 'disk_bus': 'virtio', 'attachment_id': '5f97c706-b4e5-439e-bee8-683450571779', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:16:39 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:16:39 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaBHCpOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:16:39 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:16:39 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:16:39 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1164d4-fade-4dcb-b42c-776e40971562]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:16:39 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[694f94a8-2c4c-4727-b1d1-7f6e919a2054]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd] added
Apr 11 23:16:39 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2277900b-7a48-4af6-96b1-169a3f65047e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c924ff3-ed05-467b-a135-f4bd4649cd4a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DaBHCpOu {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DaBHCpOu" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc6b4d1-4186-4821-b46e-dd401a6e897d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DaBHCpOu'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d8a103-bccc-4b8a-bc96-80838a0e971f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[940eea81-d645-41d4-9f43-a088f4c694e7]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:16:39 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:16:39 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:16:39 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:16:39 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[010a3cdd-e55d-4231-bfd5-287c332e5c8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260]
Apr 11 23:16:39 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260] successful.
Apr 11 23:16:39 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b2eb65-3bf5-4bcf-9a0e-50baf1b16339]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c42368-93ab-4574-a3ed-9d18a8d7525b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:16:39 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:16:39 user nova-compute[71516]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:16:39 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:16:39 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:16:39 user nova-compute[71516]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:16:39 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4e1258-a6bc-4934-9c47-3316fcc15134]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:16:39 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaBHCpOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26634393662616436', 'path': '/dev/sdd'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634393662616436', 'path': '/dev/sdd'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1799938273',display_name='tempest-TestVolumeBootPattern-server-1799938273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1799938273',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTeA7e6j/wrChwM1jogClH0JWZ33jOggStHh7lL1aQsrNXULlUHFl3iqjE9etghhRnMsyLyd4JqIILvNvoCcqVmiQ5foShdj8Q9wa2sI4sRIJCvJ4hRZ+cCGZXsMJkWw==',key_name='tempest-TestVolumeBootPattern-15540354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-scpdfg5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:16:35Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "251c2317-e6a3-40d8-849b-bec8357be943", "address": "fa:16:3e:c4:c9:7b", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251c2317-e6", "ovs_interfaceid": "251c2317-e6a3-40d8-849b-bec8357be943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "251c2317-e6a3-40d8-849b-bec8357be943", "address": "fa:16:3e:c4:c9:7b", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251c2317-e6", "ovs_interfaceid": "251c2317-e6a3-40d8-849b-bec8357be943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:c9:7b,bridge_name='br-int',has_traffic_filtering=True,id=251c2317-e6a3-40d8-849b-bec8357be943,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251c2317-e6') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lazy-loading 'pci_devices' on Instance uuid f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:16:40 user nova-compute[71516]:   <uuid>f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f</uuid>
Apr 11 23:16:40 user nova-compute[71516]:   <name>instance-0000001d</name>
Apr 11 23:16:40 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:16:40 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:16:40 user nova-compute[71516]:   <metadata>
Apr 11 23:16:40 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:16:40 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:16:40 user nova-compute[71516]:       <nova:name>tempest-TestVolumeBootPattern-server-1799938273</nova:name>
Apr 11 23:16:40 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:16:39</nova:creationTime>
Apr 11 23:16:40 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:16:40 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:16:40 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:16:40 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:16:40 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:16:40 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:16:40 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:16:40 user nova-compute[71516]:       <nova:owner>
Apr 11 23:16:40 user nova-compute[71516]:         <nova:user uuid="589c07cd12e849cfa38423959e76c695">tempest-TestVolumeBootPattern-365588456-project-member</nova:user>
Apr 11 23:16:40 user nova-compute[71516]:         <nova:project uuid="f6700d66136e4f9590658e3103cceac8">tempest-TestVolumeBootPattern-365588456</nova:project>
Apr 11 23:16:40 user nova-compute[71516]:       </nova:owner>
Apr 11 23:16:40 user nova-compute[71516]:       <nova:ports>
Apr 11 23:16:40 user nova-compute[71516]:         <nova:port uuid="251c2317-e6a3-40d8-849b-bec8357be943">
Apr 11 23:16:40 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:16:40 user nova-compute[71516]:         </nova:port>
Apr 11 23:16:40 user nova-compute[71516]:       </nova:ports>
Apr 11 23:16:40 user nova-compute[71516]:     </nova:instance>
Apr 11 23:16:40 user nova-compute[71516]:   </metadata>
Apr 11 23:16:40 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:16:40 user nova-compute[71516]:     <system>
Apr 11 23:16:40 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:16:40 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:16:40 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:16:40 user nova-compute[71516]:       <entry name="serial">f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f</entry>
Apr 11 23:16:40 user nova-compute[71516]:       <entry name="uuid">f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f</entry>
Apr 11 23:16:40 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:16:40 user nova-compute[71516]:     </system>
Apr 11 23:16:40 user nova-compute[71516]:   </sysinfo>
Apr 11 23:16:40 user nova-compute[71516]:   <os>
Apr 11 23:16:40 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:16:40 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:16:40 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:16:40 user nova-compute[71516]:   </os>
Apr 11 23:16:40 user nova-compute[71516]:   <features>
Apr 11 23:16:40 user nova-compute[71516]:     <acpi/>
Apr 11 23:16:40 user nova-compute[71516]:     <apic/>
Apr 11 23:16:40 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:16:40 user nova-compute[71516]:   </features>
Apr 11 23:16:40 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:16:40 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:16:40 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:16:40 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:16:40 user nova-compute[71516]:   </clock>
Apr 11 23:16:40 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:16:40 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:16:40 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:16:40 user nova-compute[71516]:   </cpu>
Apr 11 23:16:40 user nova-compute[71516]:   <devices>
Apr 11 23:16:40 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:16:40 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:16:40 user nova-compute[71516]:       <source dev="/dev/sdd"/>
Apr 11 23:16:40 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:16:40 user nova-compute[71516]:       <serial>6170821e-16c7-4cae-a138-dbac84aea6cd</serial>
Apr 11 23:16:40 user nova-compute[71516]:     </disk>
Apr 11 23:16:40 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:16:40 user nova-compute[71516]:       <mac address="fa:16:3e:c4:c9:7b"/>
Apr 11 23:16:40 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:16:40 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:16:40 user nova-compute[71516]:       <target dev="tap251c2317-e6"/>
Apr 11 23:16:40 user nova-compute[71516]:     </interface>
Apr 11 23:16:40 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:16:40 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f/console.log" append="off"/>
Apr 11 23:16:40 user nova-compute[71516]:     </serial>
Apr 11 23:16:40 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:16:40 user nova-compute[71516]:     <video>
Apr 11 23:16:40 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:16:40 user nova-compute[71516]:     </video>
Apr 11 23:16:40 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:16:40 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:16:40 user nova-compute[71516]:     </rng>
Apr 11 23:16:40 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:16:40 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:16:40 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:16:40 user nova-compute[71516]:     </memballoon>
Apr 11 23:16:40 user nova-compute[71516]:   </devices>
Apr 11 23:16:40 user nova-compute[71516]: </domain>
Apr 11 23:16:40 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1799938273',display_name='tempest-TestVolumeBootPattern-server-1799938273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1799938273',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTeA7e6j/wrChwM1jogClH0JWZ33jOggStHh7lL1aQsrNXULlUHFl3iqjE9etghhRnMsyLyd4JqIILvNvoCcqVmiQ5foShdj8Q9wa2sI4sRIJCvJ4hRZ+cCGZXsMJkWw==',key_name='tempest-TestVolumeBootPattern-15540354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-scpdfg5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:16:35Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "251c2317-e6a3-40d8-849b-bec8357be943", "address": "fa:16:3e:c4:c9:7b", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251c2317-e6", "ovs_interfaceid": "251c2317-e6a3-40d8-849b-bec8357be943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "251c2317-e6a3-40d8-849b-bec8357be943", "address": "fa:16:3e:c4:c9:7b", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251c2317-e6", "ovs_interfaceid": "251c2317-e6a3-40d8-849b-bec8357be943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:c9:7b,bridge_name='br-int',has_traffic_filtering=True,id=251c2317-e6a3-40d8-849b-bec8357be943,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251c2317-e6') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG os_vif [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:c9:7b,bridge_name='br-int',has_traffic_filtering=True,id=251c2317-e6a3-40d8-849b-bec8357be943,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251c2317-e6') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap251c2317-e6, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap251c2317-e6, col_values=(('external_ids', {'iface-id': '251c2317-e6a3-40d8-849b-bec8357be943', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:c9:7b', 'vm-uuid': 'f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:40 user nova-compute[71516]: INFO os_vif [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:c9:7b,bridge_name='br-int',has_traffic_filtering=True,id=251c2317-e6a3-40d8-849b-bec8357be943,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251c2317-e6')
Apr 11 23:16:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:16:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] No VIF found with MAC fa:16:3e:c4:c9:7b, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:16:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:16:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-ff165a2e-50a9-4304-8477-125225b077e8 req-94438310-37cc-4353-b63e-6e1bb5011bcb service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Received event network-vif-plugged-251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ff165a2e-50a9-4304-8477-125225b077e8 req-94438310-37cc-4353-b63e-6e1bb5011bcb service nova] Acquiring lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ff165a2e-50a9-4304-8477-125225b077e8 req-94438310-37cc-4353-b63e-6e1bb5011bcb service nova] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ff165a2e-50a9-4304-8477-125225b077e8 req-94438310-37cc-4353-b63e-6e1bb5011bcb service nova] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-ff165a2e-50a9-4304-8477-125225b077e8 req-94438310-37cc-4353-b63e-6e1bb5011bcb service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] No waiting events found dispatching network-vif-plugged-251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:16:42 user nova-compute[71516]: WARNING nova.compute.manager [req-ff165a2e-50a9-4304-8477-125225b077e8 req-94438310-37cc-4353-b63e-6e1bb5011bcb service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Received unexpected event network-vif-plugged-251c2317-e6a3-40d8-849b-bec8357be943 for instance with vm_state building and task_state spawning.
Apr 11 23:16:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255004.446675, f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:16:44 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] VM Resumed (Lifecycle Event)
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:16:44 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Instance spawned successfully.
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:44 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255004.4479654, f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:16:44 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] VM Started (Lifecycle Event)
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:16:44 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:16:44 user nova-compute[71516]: INFO nova.compute.manager [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Took 5.17 seconds to spawn the instance on the hypervisor.
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:44 user nova-compute[71516]: INFO nova.compute.manager [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Took 11.00 seconds to build instance.
Apr 11 23:16:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.158s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-dae7a92b-3e14-4cda-8264-092130047510 req-ac20fc58-f3e1-4998-9ad5-07ce81634b37 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Received event network-vif-plugged-251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dae7a92b-3e14-4cda-8264-092130047510 req-ac20fc58-f3e1-4998-9ad5-07ce81634b37 service nova] Acquiring lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dae7a92b-3e14-4cda-8264-092130047510 req-ac20fc58-f3e1-4998-9ad5-07ce81634b37 service nova] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dae7a92b-3e14-4cda-8264-092130047510 req-ac20fc58-f3e1-4998-9ad5-07ce81634b37 service nova] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-dae7a92b-3e14-4cda-8264-092130047510 req-ac20fc58-f3e1-4998-9ad5-07ce81634b37 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] No waiting events found dispatching network-vif-plugged-251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:16:44 user nova-compute[71516]: WARNING nova.compute.manager [req-dae7a92b-3e14-4cda-8264-092130047510 req-ac20fc58-f3e1-4998-9ad5-07ce81634b37 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Received unexpected event network-vif-plugged-251c2317-e6a3-40d8-849b-bec8357be943 for instance with vm_state active and task_state None.
Apr 11 23:16:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:45 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:16:46 user nova-compute[71516]: INFO nova.compute.claims [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Claim successful on node user
Apr 11 23:16:46 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG nova.network.neutron [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:16:46 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:16:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG nova.policy [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:16:46 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Creating image(s)
Apr 11 23:16:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "/opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "/opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "5fa3259408e2f7ed9f4e943878f36207e4602c6e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "5fa3259408e2f7ed9f4e943878f36207e4602c6e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e.part --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e.part --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG nova.virt.images [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 61c0c235-6d9e-44b6-aaf7-5005b1f3aba4 was qcow2, converting to raw {{(pid=71516) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e.part /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e.converted {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e.part /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e.converted" returned: 0 in 0.222s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e.converted --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG nova.network.neutron [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Successfully created port: 86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e.converted --force-share --output=json" returned: 0 in 0.156s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "5fa3259408e2f7ed9f4e943878f36207e4602c6e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.831s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "5fa3259408e2f7ed9f4e943878f36207e4602c6e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "5fa3259408e2f7ed9f4e943878f36207e4602c6e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e,backing_fmt=raw /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e,backing_fmt=raw /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk 1073741824" returned: 0 in 0.057s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "5fa3259408e2f7ed9f4e943878f36207e4602c6e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e --force-share --output=json" returned: 0 in 0.156s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.network.neutron [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Successfully updated port: 86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Cannot resize image /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.objects.instance [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'migration_context' on Instance uuid 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquired lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.network.neutron [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Ensure instance console log exists: /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.compute.manager [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-changed-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.compute.manager [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Refreshing instance network info cache due to event network-changed-86961f23-bd39-44da-8ad9-4420b80e9223. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] Acquiring lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.network.neutron [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.network.neutron [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updating instance_info_cache with network_info: [{"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Releasing lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Instance network_info: |[{"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] Acquired lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.network.neutron [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Refreshing network info cache for port 86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Start _get_guest_xml network_info=[{"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:16:43Z,direct_url=<?>,disk_format='qcow2',id=61c0c235-6d9e-44b6-aaf7-5005b1f3aba4,min_disk=0,min_ram=0,name='tempest-scenario-img--1930206595',owner='9e8e126b69d44b27a60c421b86b79e9f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:16:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '61c0c235-6d9e-44b6-aaf7-5005b1f3aba4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:16:48 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:16:48 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:16:43Z,direct_url=<?>,disk_format='qcow2',id=61c0c235-6d9e-44b6-aaf7-5005b1f3aba4,min_disk=0,min_ram=0,name='tempest-scenario-img--1930206595',owner='9e8e126b69d44b27a60c421b86b79e9f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:16:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1117768809',display_name='tempest-TestMinimumBasicScenario-server-1117768809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1117768809',id=30,image_ref='61c0c235-6d9e-44b6-aaf7-5005b1f3aba4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTEcgl/NhGv4Bb/P05E6qwS4i7frnTq227Fw8NjjabwTORj5LZJIXHiu7YOkH/BFyO3Oi3ku/v20lt1w55I01gZuEaexPUI/f5ofEy7HOCw5kg1vykKtzfwLhsywN4pww==',key_name='tempest-TestMinimumBasicScenario-1640213672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e8e126b69d44b27a60c421b86b79e9f',ramdisk_id='',reservation_id='r-p37n1zc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61c0c235-6d9e-44b6-aaf7-5005b1f3aba4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1152745105',owner_user_name='tempest-TestMinimumBasicScenario-1152745105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:16:47Z,user_data=None,user_id='6beb3cae81a14fa2bae48a8eedcb3868',uuid=1fec2e5a-e0bf-435d-822b-766c8c2f2d9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converting VIF {"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.objects.instance [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:16:48 user nova-compute[71516]:   <uuid>1fec2e5a-e0bf-435d-822b-766c8c2f2d9c</uuid>
Apr 11 23:16:48 user nova-compute[71516]:   <name>instance-0000001e</name>
Apr 11 23:16:48 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:16:48 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:16:48 user nova-compute[71516]:   <metadata>
Apr 11 23:16:48 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:16:48 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:16:48 user nova-compute[71516]:       <nova:name>tempest-TestMinimumBasicScenario-server-1117768809</nova:name>
Apr 11 23:16:48 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:16:48</nova:creationTime>
Apr 11 23:16:48 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:16:48 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:16:48 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:16:48 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:16:48 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:16:48 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:16:48 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:16:48 user nova-compute[71516]:       <nova:owner>
Apr 11 23:16:48 user nova-compute[71516]:         <nova:user uuid="6beb3cae81a14fa2bae48a8eedcb3868">tempest-TestMinimumBasicScenario-1152745105-project-member</nova:user>
Apr 11 23:16:48 user nova-compute[71516]:         <nova:project uuid="9e8e126b69d44b27a60c421b86b79e9f">tempest-TestMinimumBasicScenario-1152745105</nova:project>
Apr 11 23:16:48 user nova-compute[71516]:       </nova:owner>
Apr 11 23:16:48 user nova-compute[71516]:       <nova:root type="image" uuid="61c0c235-6d9e-44b6-aaf7-5005b1f3aba4"/>
Apr 11 23:16:48 user nova-compute[71516]:       <nova:ports>
Apr 11 23:16:48 user nova-compute[71516]:         <nova:port uuid="86961f23-bd39-44da-8ad9-4420b80e9223">
Apr 11 23:16:48 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 23:16:48 user nova-compute[71516]:         </nova:port>
Apr 11 23:16:48 user nova-compute[71516]:       </nova:ports>
Apr 11 23:16:48 user nova-compute[71516]:     </nova:instance>
Apr 11 23:16:48 user nova-compute[71516]:   </metadata>
Apr 11 23:16:48 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:16:48 user nova-compute[71516]:     <system>
Apr 11 23:16:48 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:16:48 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:16:48 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:16:48 user nova-compute[71516]:       <entry name="serial">1fec2e5a-e0bf-435d-822b-766c8c2f2d9c</entry>
Apr 11 23:16:48 user nova-compute[71516]:       <entry name="uuid">1fec2e5a-e0bf-435d-822b-766c8c2f2d9c</entry>
Apr 11 23:16:48 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:16:48 user nova-compute[71516]:     </system>
Apr 11 23:16:48 user nova-compute[71516]:   </sysinfo>
Apr 11 23:16:48 user nova-compute[71516]:   <os>
Apr 11 23:16:48 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:16:48 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:16:48 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:16:48 user nova-compute[71516]:   </os>
Apr 11 23:16:48 user nova-compute[71516]:   <features>
Apr 11 23:16:48 user nova-compute[71516]:     <acpi/>
Apr 11 23:16:48 user nova-compute[71516]:     <apic/>
Apr 11 23:16:48 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:16:48 user nova-compute[71516]:   </features>
Apr 11 23:16:48 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:16:48 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:16:48 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:16:48 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:16:48 user nova-compute[71516]:   </clock>
Apr 11 23:16:48 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:16:48 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:16:48 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:16:48 user nova-compute[71516]:   </cpu>
Apr 11 23:16:48 user nova-compute[71516]:   <devices>
Apr 11 23:16:48 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:16:48 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:16:48 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk"/>
Apr 11 23:16:48 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:16:48 user nova-compute[71516]:     </disk>
Apr 11 23:16:48 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:16:48 user nova-compute[71516]:       <mac address="fa:16:3e:41:3b:05"/>
Apr 11 23:16:48 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:16:48 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:16:48 user nova-compute[71516]:       <target dev="tap86961f23-bd"/>
Apr 11 23:16:48 user nova-compute[71516]:     </interface>
Apr 11 23:16:48 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:16:48 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/console.log" append="off"/>
Apr 11 23:16:48 user nova-compute[71516]:     </serial>
Apr 11 23:16:48 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:16:48 user nova-compute[71516]:     <video>
Apr 11 23:16:48 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:16:48 user nova-compute[71516]:     </video>
Apr 11 23:16:48 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:16:48 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:16:48 user nova-compute[71516]:     </rng>
Apr 11 23:16:48 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:16:48 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:16:48 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:16:48 user nova-compute[71516]:     </memballoon>
Apr 11 23:16:48 user nova-compute[71516]:   </devices>
Apr 11 23:16:48 user nova-compute[71516]: </domain>
Apr 11 23:16:48 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1117768809',display_name='tempest-TestMinimumBasicScenario-server-1117768809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1117768809',id=30,image_ref='61c0c235-6d9e-44b6-aaf7-5005b1f3aba4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTEcgl/NhGv4Bb/P05E6qwS4i7frnTq227Fw8NjjabwTORj5LZJIXHiu7YOkH/BFyO3Oi3ku/v20lt1w55I01gZuEaexPUI/f5ofEy7HOCw5kg1vykKtzfwLhsywN4pww==',key_name='tempest-TestMinimumBasicScenario-1640213672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e8e126b69d44b27a60c421b86b79e9f',ramdisk_id='',reservation_id='r-p37n1zc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61c0c235-6d9e-44b6-aaf7-5005b1f3aba4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1152745105',owner_user_name='tempest-TestMinimumBasicScenario-1152745105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:16:47Z,user_data=None,user_id='6beb3cae81a14fa2bae48a8eedcb3868',uuid=1fec2e5a-e0bf-435d-822b-766c8c2f2d9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converting VIF {"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG os_vif [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86961f23-bd, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86961f23-bd, col_values=(('external_ids', {'iface-id': '86961f23-bd39-44da-8ad9-4420b80e9223', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:3b:05', 'vm-uuid': '1fec2e5a-e0bf-435d-822b-766c8c2f2d9c'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:48 user nova-compute[71516]: INFO os_vif [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd')
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:16:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] No VIF found with MAC fa:16:3e:41:3b:05, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:16:49 user nova-compute[71516]: DEBUG nova.network.neutron [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updated VIF entry in instance network info cache for port 86961f23-bd39-44da-8ad9-4420b80e9223. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:16:49 user nova-compute[71516]: DEBUG nova.network.neutron [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updating instance_info_cache with network_info: [{"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:16:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] Releasing lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:16:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-8c68dd6d-556e-49d6-b746-532aa6cad67f req-3898b14c-d448-41de-b20d-3c150946e8c2 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8c68dd6d-556e-49d6-b746-532aa6cad67f req-3898b14c-d448-41de-b20d-3c150946e8c2 service nova] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8c68dd6d-556e-49d6-b746-532aa6cad67f req-3898b14c-d448-41de-b20d-3c150946e8c2 service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8c68dd6d-556e-49d6-b746-532aa6cad67f req-3898b14c-d448-41de-b20d-3c150946e8c2 service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-8c68dd6d-556e-49d6-b746-532aa6cad67f req-3898b14c-d448-41de-b20d-3c150946e8c2 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] No waiting events found dispatching network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:16:50 user nova-compute[71516]: WARNING nova.compute.manager [req-8c68dd6d-556e-49d6-b746-532aa6cad67f req-3898b14c-d448-41de-b20d-3c150946e8c2 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received unexpected event network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 for instance with vm_state building and task_state spawning.
Apr 11 23:16:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255012.2947183, 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:16:52 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] VM Resumed (Lifecycle Event)
Apr 11 23:16:52 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Instance spawned successfully.
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:16:52 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255012.2957327, 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:16:52 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] VM Started (Lifecycle Event)
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:16:52 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:16:52 user nova-compute[71516]: INFO nova.compute.manager [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Took 5.74 seconds to spawn the instance on the hypervisor.
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.compute.manager [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-c477c4de-23da-4b7e-91fe-9eeae20817ae req-0db5e6d8-1de6-42a5-bb32-ff255778c7c7 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c477c4de-23da-4b7e-91fe-9eeae20817ae req-0db5e6d8-1de6-42a5-bb32-ff255778c7c7 service nova] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c477c4de-23da-4b7e-91fe-9eeae20817ae req-0db5e6d8-1de6-42a5-bb32-ff255778c7c7 service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c477c4de-23da-4b7e-91fe-9eeae20817ae req-0db5e6d8-1de6-42a5-bb32-ff255778c7c7 service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-c477c4de-23da-4b7e-91fe-9eeae20817ae req-0db5e6d8-1de6-42a5-bb32-ff255778c7c7 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] No waiting events found dispatching network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:16:52 user nova-compute[71516]: WARNING nova.compute.manager [req-c477c4de-23da-4b7e-91fe-9eeae20817ae req-0db5e6d8-1de6-42a5-bb32-ff255778c7c7 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received unexpected event network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 for instance with vm_state building and task_state spawning.
Apr 11 23:16:52 user nova-compute[71516]: INFO nova.compute.manager [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Took 6.44 seconds to build instance.
Apr 11 23:16:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.538s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:16:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:16:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Received event network-changed-cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:17:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Refreshing instance network info cache due to event network-changed-cab6e033-a51b-4b0b-9e76-c55de3afcef6. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:17:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] Acquiring lock "refresh_cache-f1a98583-cd58-4078-999f-f2bfb3a50c48" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:17:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] Acquired lock "refresh_cache-f1a98583-cd58-4078-999f-f2bfb3a50c48" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:17:08 user nova-compute[71516]: DEBUG nova.network.neutron [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Refreshing network info cache for port cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:17:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:08 user nova-compute[71516]: DEBUG nova.network.neutron [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Updated VIF entry in instance network info cache for port cab6e033-a51b-4b0b-9e76-c55de3afcef6. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:17:08 user nova-compute[71516]: DEBUG nova.network.neutron [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Updating instance_info_cache with network_info: [{"id": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "address": "fa:16:3e:64:cb:bc", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab6e033-a5", "ovs_interfaceid": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:17:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] Releasing lock "refresh_cache-f1a98583-cd58-4078-999f-f2bfb3a50c48" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:17:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG nova.objects.instance [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'flavor' on Instance uuid f1a98583-cd58-4078-999f-f2bfb3a50c48 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:10 user nova-compute[71516]: INFO nova.compute.manager [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Attaching volume 9e2058e1-f925-4535-8b08-6fd8bc0f20c8 to /dev/vdb
Apr 11 23:17:10 user nova-compute[71516]: DEBUG os_brick.utils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[77696b5a-260e-4c37-a0c7-1b19feb06a7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dec89d-dfa4-439a-8f34-c6cc45fe1a59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac8e1b4-ec39-46fe-924e-59b7754e633c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0e2e3a-491c-4520-9a1a-63e86a06271c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:17:10 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:17:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc0b19e-0f2b-4772-82cf-b708f4810c53]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG os_brick.utils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Updating existing volume attachment record: f2748443-9e5f-40f4-a247-7edb8ec86026 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:17:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWjkeNOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:17:14 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:17:14 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:17:14 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d64b321-bec1-4f26-9368-4bcda58823a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:17:14 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3fcfb9-fb6e-4af6-a4d7-b5f6b85f90ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8] added
Apr 11 23:17:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[19619050-6176-45f1-b42b-0c2034ecbb71]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8048070-7b44-4f60-bc17-723a5d0cddb3]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWjkeNOy {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWjkeNOy" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6dee75-7e02-40fc-9178-9d9002f43b49]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XWjkeNOy'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f3418e-30ba-42a9-9112-2bcb03bb3d15]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90911e6-0ceb-4edf-b157-fc0a66914100]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:17:14 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:17:14 user nova-compute[71516]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:17:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:17:14 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:17:14 user nova-compute[71516]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:17:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[412092dd-33b6-4465-b8a4-ad9e2eb69b15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8, portal: 172.16.0.220,3260]
Apr 11 23:17:14 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8, portal: 172.16.0.220,3260] successful.
Apr 11 23:17:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0029b7-ccac-4a26-a8d9-9a9ba1cbeb5c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11f9863-9923-459c-b0d4-056852c84b6f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:17:14 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:17:14 user nova-compute[71516]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:17:14 user nova-compute[71516]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 (non-flash)
Apr 11 23:17:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:17:14 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:17:14 user nova-compute[71516]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:17:14 user nova-compute[71516]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 (non-flash)
Apr 11 23:17:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2240d2f-ea32-44cf-bff2-1dcb71fc1386]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: None {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:17:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:17:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWjkeNOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:17:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:17:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23666646462656263', 'path': '/dev/sde'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:17:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666646462656263', 'path': '/dev/sde'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:17:15 user nova-compute[71516]: DEBUG nova.objects.instance [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'flavor' on Instance uuid f1a98583-cd58-4078-999f-f2bfb3a50c48 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:17:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:17:15 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:17:15 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:17:15 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:17:15 user nova-compute[71516]:   <serial>9e2058e1-f925-4535-8b08-6fd8bc0f20c8</serial>
Apr 11 23:17:15 user nova-compute[71516]: </disk>
Apr 11 23:17:15 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:17:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:17:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:17:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No VIF found with MAC fa:16:3e:64:cb:bc, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:17:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.192s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:17 user nova-compute[71516]: INFO nova.compute.manager [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Detaching volume 9e2058e1-f925-4535-8b08-6fd8bc0f20c8
Apr 11 23:17:17 user nova-compute[71516]: INFO nova.virt.block_device [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Attempting to driver detach volume 9e2058e1-f925-4535-8b08-6fd8bc0f20c8 from mountpoint /dev/vdb
Apr 11 23:17:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Attempting to detach device vdb from instance f1a98583-cd58-4078-999f-f2bfb3a50c48 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:17:17 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:17:17 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:17:17 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:17:17 user nova-compute[71516]:   <serial>9e2058e1-f925-4535-8b08-6fd8bc0f20c8</serial>
Apr 11 23:17:17 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:17:17 user nova-compute[71516]: </disk>
Apr 11 23:17:17 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:17:17 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully detached device vdb from instance f1a98583-cd58-4078-999f-f2bfb3a50c48 from the persistent domain config.
Apr 11 23:17:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1a98583-cd58-4078-999f-f2bfb3a50c48 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:17:17 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:17:17 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:17:17 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:17:17 user nova-compute[71516]:   <serial>9e2058e1-f925-4535-8b08-6fd8bc0f20c8</serial>
Apr 11 23:17:17 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:17:17 user nova-compute[71516]: </disk>
Apr 11 23:17:17 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681255037.6115103, f1a98583-cd58-4078-999f-f2bfb3a50c48 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1a98583-cd58-4078-999f-f2bfb3a50c48 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:17:17 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully detached device vdb from instance f1a98583-cd58-4078-999f-f2bfb3a50c48 from the live domain config.
Apr 11 23:17:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWjkeNOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:17:17 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9b475b-5930-4ab5-a94d-905313717928]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:17:17 user nova-compute[71516]: No targets found.
Apr 11 23:17:17 user nova-compute[71516]: iSNS:
Apr 11 23:17:17 user nova-compute[71516]: No targets found.
Apr 11 23:17:17 user nova-compute[71516]: STATIC:
Apr 11 23:17:17 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8
Apr 11 23:17:17 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:17:17 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:17:17 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5
Apr 11 23:17:17 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:17:17 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:17:17 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94
Apr 11 23:17:17 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:17:17 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:17:17 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd
Apr 11 23:17:17 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:17:17 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:17:17 user nova-compute[71516]: FIRMWARE:
Apr 11 23:17:17 user nova-compute[71516]: No targets found.
Apr 11 23:17:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:17:17 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:17:17 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd32fac-f4d7-4061-bc66-16b5c9bf0d82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[69651661-16a4-4e68-865a-b78c2a0d45da]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:17:17 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:17:17 user nova-compute[71516]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:17:17 user nova-compute[71516]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 (non-flash)
Apr 11 23:17:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:17:17 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:17:17 user nova-compute[71516]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:17:17 user nova-compute[71516]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 (non-flash)
Apr 11 23:17:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c716290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8'): ({'sde'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Removing single pathed devices sde {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63af579-4d4a-4afd-a440-72bda233fa62]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ed9077-7db3-4115-9734-055fd802d968]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flushing IO for device /dev/sde {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df87509-eedd-47a0-b823-ff568d67eb2a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e72588f-fe28-4223-8930-64f7021ca15a]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[381b3d70-46ce-4595-8ad9-72291f5c6ad3]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[26aef1f2-f76a-49e6-b009-f4621cc18761]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8, portal: 172.16.0.220,3260]
Apr 11 23:17:17 user nova-compute[71516]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8, portal: 172.16.0.220,3260] successful.
Apr 11 23:17:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e2058e1-f925-4535-8b08-6fd8bc0f20c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[244e1f82-df7a-4df6-a8a7-82d0537ac827]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] <== disconnect_volume: return (320ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:17:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:17:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:18 user nova-compute[71516]: DEBUG nova.objects.instance [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'flavor' on Instance uuid f1a98583-cd58-4078-999f-f2bfb3a50c48 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:17:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.660s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:29 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:17:33 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:17:33 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=7722MB free_disk=26.20632553100586GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e4d31874-4273-48bc-8811-89832d18b893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:17:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:34 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:17:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:17:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:17:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:17:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:17:34 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:17:34 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:17:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating instance_info_cache with network_info: [{"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:17:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-eed8cea5-9e5c-4467-8993-456cb3235fd8" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:17:35 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:17:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:36 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:17:36 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:17:36 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:17:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:17:38 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:17:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:39 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:17:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:43 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:17:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:45 user nova-compute[71516]: INFO nova.compute.manager [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Rescuing
Apr 11 23:17:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:17:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquired lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:17:45 user nova-compute[71516]: DEBUG nova.network.neutron [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:17:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG nova.network.neutron [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Updating instance_info_cache with network_info: [{"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Releasing lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-58eb7c55-5495-4315-88a0-37d2c55db8ba req-62bc7c19-ee5d-4c29-8e20-762181125c94 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-unplugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-58eb7c55-5495-4315-88a0-37d2c55db8ba req-62bc7c19-ee5d-4c29-8e20-762181125c94 service nova] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-58eb7c55-5495-4315-88a0-37d2c55db8ba req-62bc7c19-ee5d-4c29-8e20-762181125c94 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-58eb7c55-5495-4315-88a0-37d2c55db8ba req-62bc7c19-ee5d-4c29-8e20-762181125c94 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-58eb7c55-5495-4315-88a0-37d2c55db8ba req-62bc7c19-ee5d-4c29-8e20-762181125c94 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] No waiting events found dispatching network-vif-unplugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:17:46 user nova-compute[71516]: WARNING nova.compute.manager [req-58eb7c55-5495-4315-88a0-37d2c55db8ba req-62bc7c19-ee5d-4c29-8e20-762181125c94 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received unexpected event network-vif-unplugged-af81e577-93ac-47a7-8666-377d53fad5c2 for instance with vm_state active and task_state rescuing.
Apr 11 23:17:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:46 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Instance destroyed successfully.
Apr 11 23:17:46 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Attempting rescue
Apr 11 23:17:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71516) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Instance directory exists: not creating {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 23:17:46 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Creating image(s)
Apr 11 23:17:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "/opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "/opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG nova.objects.instance [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'trusted_certs' on Instance uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.rescue {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.rescue" returned: 0 in 0.051s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.objects.instance [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'migration_context' on Instance uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Start _get_guest_xml network_info=[{"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "vif_mac": "fa:16:3e:24:11:46"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.objects.instance [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'resources' on Instance uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.objects.instance [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'numa_topology' on Instance uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:17:47 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:17:47 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.objects.instance [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'vcpu_model' on Instance uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1692522881',display_name='tempest-ServerRescueNegativeTestJSON-server-1692522881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1692522881',id=23,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:13:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31c373270f804948a04c8125848fa181',ramdisk_id='',reservation_id='r-wpvajt0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-242021724',owner_user_name='tempest-ServerRescueNegativeTestJSON-242021724-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:13:11Z,user_data=None,user_id='8d63779eda794ef0b2413ac1483f88b8',uuid=dd8aa618-99bb-49d7-b547-e5db4470f4c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "vif_mac": "fa:16:3e:24:11:46"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converting VIF {"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "vif_mac": "fa:16:3e:24:11:46"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:11:46,bridge_name='br-int',has_traffic_filtering=True,id=af81e577-93ac-47a7-8666-377d53fad5c2,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81e577-93') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.objects.instance [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'pci_devices' on Instance uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:17:47 user nova-compute[71516]:   <uuid>dd8aa618-99bb-49d7-b547-e5db4470f4c6</uuid>
Apr 11 23:17:47 user nova-compute[71516]:   <name>instance-00000017</name>
Apr 11 23:17:47 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:17:47 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:17:47 user nova-compute[71516]:   <metadata>
Apr 11 23:17:47 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:17:47 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:17:47 user nova-compute[71516]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1692522881</nova:name>
Apr 11 23:17:47 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:17:47</nova:creationTime>
Apr 11 23:17:47 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:17:47 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:17:47 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:17:47 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:17:47 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:17:47 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:17:47 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:17:47 user nova-compute[71516]:       <nova:owner>
Apr 11 23:17:47 user nova-compute[71516]:         <nova:user uuid="8d63779eda794ef0b2413ac1483f88b8">tempest-ServerRescueNegativeTestJSON-242021724-project-member</nova:user>
Apr 11 23:17:47 user nova-compute[71516]:         <nova:project uuid="31c373270f804948a04c8125848fa181">tempest-ServerRescueNegativeTestJSON-242021724</nova:project>
Apr 11 23:17:47 user nova-compute[71516]:       </nova:owner>
Apr 11 23:17:47 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:17:47 user nova-compute[71516]:       <nova:ports>
Apr 11 23:17:47 user nova-compute[71516]:         <nova:port uuid="af81e577-93ac-47a7-8666-377d53fad5c2">
Apr 11 23:17:47 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 23:17:47 user nova-compute[71516]:         </nova:port>
Apr 11 23:17:47 user nova-compute[71516]:       </nova:ports>
Apr 11 23:17:47 user nova-compute[71516]:     </nova:instance>
Apr 11 23:17:47 user nova-compute[71516]:   </metadata>
Apr 11 23:17:47 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:17:47 user nova-compute[71516]:     <system>
Apr 11 23:17:47 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:17:47 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:17:47 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:17:47 user nova-compute[71516]:       <entry name="serial">dd8aa618-99bb-49d7-b547-e5db4470f4c6</entry>
Apr 11 23:17:47 user nova-compute[71516]:       <entry name="uuid">dd8aa618-99bb-49d7-b547-e5db4470f4c6</entry>
Apr 11 23:17:47 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:17:47 user nova-compute[71516]:     </system>
Apr 11 23:17:47 user nova-compute[71516]:   </sysinfo>
Apr 11 23:17:47 user nova-compute[71516]:   <os>
Apr 11 23:17:47 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:17:47 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:17:47 user nova-compute[71516]:   </os>
Apr 11 23:17:47 user nova-compute[71516]:   <features>
Apr 11 23:17:47 user nova-compute[71516]:     <acpi/>
Apr 11 23:17:47 user nova-compute[71516]:     <apic/>
Apr 11 23:17:47 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:17:47 user nova-compute[71516]:   </features>
Apr 11 23:17:47 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:17:47 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:17:47 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:17:47 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:17:47 user nova-compute[71516]:   </clock>
Apr 11 23:17:47 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:17:47 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:17:47 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:17:47 user nova-compute[71516]:   </cpu>
Apr 11 23:17:47 user nova-compute[71516]:   <devices>
Apr 11 23:17:47 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:17:47 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:17:47 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.rescue"/>
Apr 11 23:17:47 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:17:47 user nova-compute[71516]:     </disk>
Apr 11 23:17:47 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:17:47 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:17:47 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk"/>
Apr 11 23:17:47 user nova-compute[71516]:       <target dev="vdb" bus="virtio"/>
Apr 11 23:17:47 user nova-compute[71516]:     </disk>
Apr 11 23:17:47 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:17:47 user nova-compute[71516]:       <mac address="fa:16:3e:24:11:46"/>
Apr 11 23:17:47 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:17:47 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:17:47 user nova-compute[71516]:       <target dev="tapaf81e577-93"/>
Apr 11 23:17:47 user nova-compute[71516]:     </interface>
Apr 11 23:17:47 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:17:47 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/console.log" append="off"/>
Apr 11 23:17:47 user nova-compute[71516]:     </serial>
Apr 11 23:17:47 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:17:47 user nova-compute[71516]:     <video>
Apr 11 23:17:47 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:17:47 user nova-compute[71516]:     </video>
Apr 11 23:17:47 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:17:47 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:17:47 user nova-compute[71516]:     </rng>
Apr 11 23:17:47 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:17:47 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:17:47 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:17:47 user nova-compute[71516]:     </memballoon>
Apr 11 23:17:47 user nova-compute[71516]:   </devices>
Apr 11 23:17:47 user nova-compute[71516]: </domain>
Apr 11 23:17:47 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:17:47 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Instance destroyed successfully.
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:17:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No VIF found with MAC fa:16:3e:24:11:46, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:17:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:48 user nova-compute[71516]: DEBUG nova.compute.manager [req-be231da8-d6bc-498a-a4cc-eceaadac20bc req-9e03df9f-4627-49ff-b164-f8e12824ded4 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:17:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-be231da8-d6bc-498a-a4cc-eceaadac20bc req-9e03df9f-4627-49ff-b164-f8e12824ded4 service nova] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-be231da8-d6bc-498a-a4cc-eceaadac20bc req-9e03df9f-4627-49ff-b164-f8e12824ded4 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-be231da8-d6bc-498a-a4cc-eceaadac20bc req-9e03df9f-4627-49ff-b164-f8e12824ded4 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:48 user nova-compute[71516]: DEBUG nova.compute.manager [req-be231da8-d6bc-498a-a4cc-eceaadac20bc req-9e03df9f-4627-49ff-b164-f8e12824ded4 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] No waiting events found dispatching network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:17:48 user nova-compute[71516]: WARNING nova.compute.manager [req-be231da8-d6bc-498a-a4cc-eceaadac20bc req-9e03df9f-4627-49ff-b164-f8e12824ded4 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received unexpected event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 for instance with vm_state active and task_state rescuing.
Apr 11 23:17:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:50 user nova-compute[71516]: INFO nova.compute.manager [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Terminating instance
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-5cab17e1-8bc1-4185-aa6d-276b299d4ef8 req-9d9c5ac4-034f-4eb2-85b4-3ad292faa8a7 service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-vif-unplugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5cab17e1-8bc1-4185-aa6d-276b299d4ef8 req-9d9c5ac4-034f-4eb2-85b4-3ad292faa8a7 service nova] Acquiring lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5cab17e1-8bc1-4185-aa6d-276b299d4ef8 req-9d9c5ac4-034f-4eb2-85b4-3ad292faa8a7 service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5cab17e1-8bc1-4185-aa6d-276b299d4ef8 req-9d9c5ac4-034f-4eb2-85b4-3ad292faa8a7 service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-5cab17e1-8bc1-4185-aa6d-276b299d4ef8 req-9d9c5ac4-034f-4eb2-85b4-3ad292faa8a7 service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] No waiting events found dispatching network-vif-unplugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-5cab17e1-8bc1-4185-aa6d-276b299d4ef8 req-9d9c5ac4-034f-4eb2-85b4-3ad292faa8a7 service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-vif-unplugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] No waiting events found dispatching network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:17:50 user nova-compute[71516]: WARNING nova.compute.manager [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received unexpected event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 for instance with vm_state active and task_state rescuing.
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.compute.manager [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] No waiting events found dispatching network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:17:50 user nova-compute[71516]: WARNING nova.compute.manager [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received unexpected event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 for instance with vm_state active and task_state rescuing.
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for dd8aa618-99bb-49d7-b547-e5db4470f4c6 due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255070.8814833, dd8aa618-99bb-49d7-b547-e5db4470f4c6 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:17:50 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] VM Resumed (Lifecycle Event)
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:17:50 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Instance destroyed successfully.
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.objects.instance [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'resources' on Instance uuid fab7f71b-57f6-415b-9d2d-262a8ec6cb03 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1536485804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1536485804',id=21,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWDui0SPuSNcW3iQQT+n8CdN0Nt1xzZAZfHsKqwSiujdTOOOEDSXAwM3wlZDgrq/pjBr0c+y+HW1Zg37Jw+CuC31UFynDxv2RaP8mEcuOy82rtfiD6ySkPqukQhekjgAg==',key_name='tempest-keypair-865048007',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:16:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b466a7e141a247319eae64ab30aca760',ramdisk_id='',reservation_id='r-05tlqmg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849897654',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849897654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:16:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7272af33be864737b2231127f4323638',uuid=fab7f71b-57f6-415b-9d2d-262a8ec6cb03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converting VIF {"id": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "address": "fa:16:3e:e7:9e:95", "network": {"id": "6af6f111-70ec-4fd4-8d8c-d05bd0886155", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-56033791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b466a7e141a247319eae64ab30aca760", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6c4dd1-5b", "ovs_interfaceid": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG os_vif [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f6c4dd1-5b, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:17:50 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255070.8833568, dd8aa618-99bb-49d7-b547-e5db4470f4c6 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:17:50 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] VM Started (Lifecycle Event)
Apr 11 23:17:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:17:50 user nova-compute[71516]: INFO os_vif [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9e:95,bridge_name='br-int',has_traffic_filtering=True,id=5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a,network=Network(6af6f111-70ec-4fd4-8d8c-d05bd0886155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6c4dd1-5b')
Apr 11 23:17:50 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Deleting instance files /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03_del
Apr 11 23:17:50 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Deletion of /opt/stack/data/nova/instances/fab7f71b-57f6-415b-9d2d-262a8ec6cb03_del complete
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:17:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:17:51 user nova-compute[71516]: INFO nova.compute.manager [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 11 23:17:51 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:17:51 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:17:51 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:17:51 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:17:51 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Took 0.87 seconds to deallocate network for instance.
Apr 11 23:17:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:52 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:17:52 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:17:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:52 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Deleted allocations for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03
Apr 11 23:17:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.081s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:17:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] Acquiring lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:17:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:17:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] Lock "fab7f71b-57f6-415b-9d2d-262a8ec6cb03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:17:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] No waiting events found dispatching network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:17:52 user nova-compute[71516]: WARNING nova.compute.manager [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received unexpected event network-vif-plugged-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance with vm_state deleted and task_state None.
Apr 11 23:17:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Received event network-vif-deleted-5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:17:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-changed-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Refreshing instance network info cache due to event network-changed-5bd8ff97-1370-4a98-8111-ac1c6635a9ee. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:18:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] Acquiring lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:18:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] Acquired lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:18:01 user nova-compute[71516]: DEBUG nova.network.neutron [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Refreshing network info cache for port 5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:18:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:01 user nova-compute[71516]: INFO nova.compute.manager [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Shelve offloading
Apr 11 23:18:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG nova.network.neutron [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updated VIF entry in instance network info cache for port 5bd8ff97-1370-4a98-8111-ac1c6635a9ee. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG nova.network.neutron [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updating instance_info_cache with network_info: [{"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] Releasing lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG nova.compute.manager [req-0cbf9109-197b-40b7-b1e0-5756d5a31d68 req-96f2489b-da90-4eb6-905f-d1039bee5b07 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-vif-unplugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0cbf9109-197b-40b7-b1e0-5756d5a31d68 req-96f2489b-da90-4eb6-905f-d1039bee5b07 service nova] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0cbf9109-197b-40b7-b1e0-5756d5a31d68 req-96f2489b-da90-4eb6-905f-d1039bee5b07 service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0cbf9109-197b-40b7-b1e0-5756d5a31d68 req-96f2489b-da90-4eb6-905f-d1039bee5b07 service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG nova.compute.manager [req-0cbf9109-197b-40b7-b1e0-5756d5a31d68 req-96f2489b-da90-4eb6-905f-d1039bee5b07 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] No waiting events found dispatching network-vif-unplugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:18:02 user nova-compute[71516]: WARNING nova.compute.manager [req-0cbf9109-197b-40b7-b1e0-5756d5a31d68 req-96f2489b-da90-4eb6-905f-d1039bee5b07 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received unexpected event network-vif-unplugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance with vm_state active and task_state shelving.
Apr 11 23:18:02 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Instance destroyed successfully.
Apr 11 23:18:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquired lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:18:02 user nova-compute[71516]: DEBUG nova.network.neutron [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updating instance_info_cache with network_info: [{"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Releasing lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:18:03 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Instance destroyed successfully.
Apr 11 23:18:03 user nova-compute[71516]: DEBUG nova.objects.instance [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lazy-loading 'resources' on Instance uuid 8d9f6a0d-caab-4f42-a9b1-a4653b90559f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1643016946',display_name='tempest-TestShelveInstance-server-1643016946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1643016946',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgAA/M8o66n0P5gxuVKww0/BCxA0rUaiV6ohdeuypE0j3Kmiiiuava13qXCYccyFsmSc/AuIKI2xHRcKEGO3MwIJuyx6Z95uIU1juqzY2j0pbX2+qlSqsiVm9Z0Pwdf/A==',key_name='tempest-TestShelveInstance-1561116455',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:16:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3252362661dd4f8c9ad6298048a84c6a',ramdisk_id='',reservation_id='r-k4wk8wut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-932398179',owner_user_name='tempest-TestShelveInstance-932398179-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:16:20Z,user_data=None,user_id='acfb7fc33f4e4694bcc224292ac5f231',uuid=8d9f6a0d-caab-4f42-a9b1-a4653b90559f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Converting VIF {"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_vif [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bd8ff97-13, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-changed-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Refreshing instance network info cache due to event network-changed-5bd8ff97-1370-4a98-8111-ac1c6635a9ee. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] Acquiring lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] Acquired lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG nova.network.neutron [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Refreshing network info cache for port 5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:18:03 user nova-compute[71516]: INFO os_vif [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13')
Apr 11 23:18:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePzEAZJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:18:03 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aa1e45-7526-4581-83cb-e50ffd52925e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:18:03 user nova-compute[71516]: No targets found.
Apr 11 23:18:03 user nova-compute[71516]: iSNS:
Apr 11 23:18:03 user nova-compute[71516]: No targets found.
Apr 11 23:18:03 user nova-compute[71516]: STATIC:
Apr 11 23:18:03 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5
Apr 11 23:18:03 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:18:03 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:18:03 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94
Apr 11 23:18:03 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:18:03 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:18:03 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd
Apr 11 23:18:03 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:18:03 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:18:03 user nova-compute[71516]: FIRMWARE:
Apr 11 23:18:03 user nova-compute[71516]: No targets found.
Apr 11 23:18:03 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:18:03 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:18:03 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[19105aae-0422-4fca-9c37-b711f7a51df4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1662559e-4d4e-4c4e-a21f-533667fa189f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:18:03 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:18:03 user nova-compute[71516]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:03 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:18:03 user nova-compute[71516]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:18:03 user nova-compute[71516]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:03 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c140040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45d5097-f7c1-4c71-9071-56a7dba8b8d1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eece6b-ae65-4dbe-b284-764ae5833587]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8589b40-1003-44e4-a3c8-00b201261c73]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[907f55c4-3cb0-4630-b1b6-5238e907ee42]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd284d52-c32e-47a7-a22a-01f5fb817728]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ca3059-599d-43f7-b737-4249343f06f6]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260]
Apr 11 23:18:04 user nova-compute[71516]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260] successful.
Apr 11 23:18:04 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b499b309-cca3-4f70-8e9f-0f01e1733265]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] <== disconnect_volume: return (315ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:18:04 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Deleting instance files /opt/stack/data/nova/instances/8d9f6a0d-caab-4f42-a9b1-a4653b90559f_del
Apr 11 23:18:04 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Deletion of /opt/stack/data/nova/instances/8d9f6a0d-caab-4f42-a9b1-a4653b90559f_del complete
Apr 11 23:18:04 user nova-compute[71516]: DEBUG nova.network.neutron [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updated VIF entry in instance network info cache for port 5bd8ff97-1370-4a98-8111-ac1c6635a9ee. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG nova.network.neutron [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updating instance_info_cache with network_info: [{"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": null, "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] Releasing lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG nova.compute.manager [req-40a3b4dc-722b-404c-b50f-b2b8acb701d5 req-a0cebf51-311f-4248-a510-91d8e9a6168b service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-40a3b4dc-722b-404c-b50f-b2b8acb701d5 req-a0cebf51-311f-4248-a510-91d8e9a6168b service nova] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-40a3b4dc-722b-404c-b50f-b2b8acb701d5 req-a0cebf51-311f-4248-a510-91d8e9a6168b service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-40a3b4dc-722b-404c-b50f-b2b8acb701d5 req-a0cebf51-311f-4248-a510-91d8e9a6168b service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:04 user nova-compute[71516]: DEBUG nova.compute.manager [req-40a3b4dc-722b-404c-b50f-b2b8acb701d5 req-a0cebf51-311f-4248-a510-91d8e9a6168b service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] No waiting events found dispatching network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:18:04 user nova-compute[71516]: WARNING nova.compute.manager [req-40a3b4dc-722b-404c-b50f-b2b8acb701d5 req-a0cebf51-311f-4248-a510-91d8e9a6168b service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received unexpected event network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance with vm_state active and task_state shelving.
Apr 11 23:18:05 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Deleted allocations for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f
Apr 11 23:18:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:05 user nova-compute[71516]: DEBUG nova.objects.instance [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d9f6a0d-caab-4f42-a9b1-a4653b90559f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:18:05 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:18:05 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:18:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.570s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:05 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255070.8813322, fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:18:05 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] VM Stopped (Lifecycle Event)
Apr 11 23:18:05 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b29dd0b2-9bd8-474d-b127-7d1303d05753 None None] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:07 user nova-compute[71516]: INFO nova.compute.manager [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Terminating instance
Apr 11 23:18:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-f6767d4f-fce6-4681-a3b4-d6767681533c req-f5bca3ba-4fab-43e4-9f0f-d8cf7328d684 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Received event network-vif-unplugged-cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f6767d4f-fce6-4681-a3b4-d6767681533c req-f5bca3ba-4fab-43e4-9f0f-d8cf7328d684 service nova] Acquiring lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f6767d4f-fce6-4681-a3b4-d6767681533c req-f5bca3ba-4fab-43e4-9f0f-d8cf7328d684 service nova] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f6767d4f-fce6-4681-a3b4-d6767681533c req-f5bca3ba-4fab-43e4-9f0f-d8cf7328d684 service nova] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-f6767d4f-fce6-4681-a3b4-d6767681533c req-f5bca3ba-4fab-43e4-9f0f-d8cf7328d684 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] No waiting events found dispatching network-vif-unplugged-cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:18:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-f6767d4f-fce6-4681-a3b4-d6767681533c req-f5bca3ba-4fab-43e4-9f0f-d8cf7328d684 service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Received event network-vif-unplugged-cab6e033-a51b-4b0b-9e76-c55de3afcef6 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:18:08 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Instance destroyed successfully.
Apr 11 23:18:08 user nova-compute[71516]: DEBUG nova.objects.instance [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'resources' on Instance uuid f1a98583-cd58-4078-999f-f2bfb3a50c48 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:18:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-131271423',display_name='tempest-AttachVolumeNegativeTest-server-131271423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-131271423',id=27,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqiBFzmneB80tP6Tj+qnl3+1eC133Qn4aI89AQCOP2iFxgPQXn34wxavPyq4/G//gf7atdxb0KzJCdIbFr2aiqBtboY8aU8MocAETUKCiEdjsmvXRKyD49TLOFZwfjIOg==',key_name='tempest-keypair-357942564',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f29d28c472c4f65b8437ce443d208c7',ramdisk_id='',reservation_id='r-0lyjb1pe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2123485934',owner_user_name='tempest-AttachVolumeNegativeTest-2123485934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da1389f3e27f49f394598636d041a9c9',uuid=f1a98583-cd58-4078-999f-f2bfb3a50c48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "address": "fa:16:3e:64:cb:bc", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab6e033-a5", "ovs_interfaceid": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:18:08 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converting VIF {"id": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "address": "fa:16:3e:64:cb:bc", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab6e033-a5", "ovs_interfaceid": "cab6e033-a51b-4b0b-9e76-c55de3afcef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:18:08 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:cb:bc,bridge_name='br-int',has_traffic_filtering=True,id=cab6e033-a51b-4b0b-9e76-c55de3afcef6,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab6e033-a5') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:18:08 user nova-compute[71516]: DEBUG os_vif [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:cb:bc,bridge_name='br-int',has_traffic_filtering=True,id=cab6e033-a51b-4b0b-9e76-c55de3afcef6,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab6e033-a5') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:18:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcab6e033-a5, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:18:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:18:08 user nova-compute[71516]: INFO os_vif [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:cb:bc,bridge_name='br-int',has_traffic_filtering=True,id=cab6e033-a51b-4b0b-9e76-c55de3afcef6,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab6e033-a5')
Apr 11 23:18:08 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Deleting instance files /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48_del
Apr 11 23:18:08 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Deletion of /opt/stack/data/nova/instances/f1a98583-cd58-4078-999f-f2bfb3a50c48_del complete
Apr 11 23:18:08 user nova-compute[71516]: INFO nova.compute.manager [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 23:18:08 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:18:08 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:18:08 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:18:08 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:08 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Took 0.64 seconds to deallocate network for instance.
Apr 11 23:18:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:09 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:18:09 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:18:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:09 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Deleted allocations for instance f1a98583-cd58-4078-999f-f2bfb3a50c48
Apr 11 23:18:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.938s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Received event network-vif-plugged-cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] Acquiring lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] Lock "f1a98583-cd58-4078-999f-f2bfb3a50c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] No waiting events found dispatching network-vif-plugged-cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:18:09 user nova-compute[71516]: WARNING nova.compute.manager [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Received unexpected event network-vif-plugged-cab6e033-a51b-4b0b-9e76-c55de3afcef6 for instance with vm_state deleted and task_state None.
Apr 11 23:18:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Received event network-vif-deleted-cab6e033-a51b-4b0b-9e76-c55de3afcef6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:14 user nova-compute[71516]: INFO nova.compute.manager [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Terminating instance
Apr 11 23:18:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG nova.compute.manager [req-0d0ee1e6-ea5e-45e3-b8f4-6c0491cd6213 req-4736eab8-e172-4050-9b93-31667f3d4f50 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-unplugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0d0ee1e6-ea5e-45e3-b8f4-6c0491cd6213 req-4736eab8-e172-4050-9b93-31667f3d4f50 service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0d0ee1e6-ea5e-45e3-b8f4-6c0491cd6213 req-4736eab8-e172-4050-9b93-31667f3d4f50 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0d0ee1e6-ea5e-45e3-b8f4-6c0491cd6213 req-4736eab8-e172-4050-9b93-31667f3d4f50 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG nova.compute.manager [req-0d0ee1e6-ea5e-45e3-b8f4-6c0491cd6213 req-4736eab8-e172-4050-9b93-31667f3d4f50 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-unplugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:18:14 user nova-compute[71516]: DEBUG nova.compute.manager [req-0d0ee1e6-ea5e-45e3-b8f4-6c0491cd6213 req-4736eab8-e172-4050-9b93-31667f3d4f50 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-unplugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:18:15 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Instance destroyed successfully.
Apr 11 23:18:15 user nova-compute[71516]: DEBUG nova.objects.instance [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'resources' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1831107086',display_name='tempest-ServerActionsTestJSON-server-1247380178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1831107086',id=2,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-pn29cvap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:15:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=eed8cea5-9e5c-4467-8993-456cb3235fd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "address": "fa:16:3e:ec:10:5e", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap961d8195-c0", "ovs_interfaceid": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_vif [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap961d8195-c0, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:18:15 user nova-compute[71516]: INFO os_vif [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:10:5e,bridge_name='br-int',has_traffic_filtering=True,id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap961d8195-c0')
Apr 11 23:18:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peWsXVHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:18:15 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e344310-ba6b-4dfc-bc98-9a5901676d98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:18:15 user nova-compute[71516]: No targets found.
Apr 11 23:18:15 user nova-compute[71516]: iSNS:
Apr 11 23:18:15 user nova-compute[71516]: No targets found.
Apr 11 23:18:15 user nova-compute[71516]: STATIC:
Apr 11 23:18:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5
Apr 11 23:18:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:18:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:18:15 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd
Apr 11 23:18:15 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:18:15 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:18:15 user nova-compute[71516]: FIRMWARE:
Apr 11 23:18:15 user nova-compute[71516]: No targets found.
Apr 11 23:18:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:18:15 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:18:15 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ff083c-c520-4a70-980b-e8f48373da3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5571725c-3af5-4e63-a4d3-099cebd032c2]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:18:15 user nova-compute[71516]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 (non-flash)
Apr 11 23:18:15 user nova-compute[71516]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c4ea050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5'): ({'sdb'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Removing single pathed devices sdb {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a8e9ca-de37-4b5c-a041-00a366127cac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b12f77-baa1-4c54-ab45-6c94020949f8]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flushing IO for device /dev/sdb {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[255a42a3-6f7a-40c4-83f8-3b9db666a1d1]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea1ddb3-060f-40fb-b324-6cf003eedb7f]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b418e8-c0ce-43ae-afe8-4bea321438ec]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[473cbed7-3726-4ca5-b722-dc2b835039dc]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260]
Apr 11 23:18:15 user nova-compute[71516]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5, portal: 172.16.0.220,3260] successful.
Apr 11 23:18:15 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3f3e9-087d-4fc0-a462-78564949fef5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bce94d8-d4db-41f1-8a7f-90cbea1a040a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== disconnect_volume: return (302ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:18:15 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Deleting instance files /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8_del
Apr 11 23:18:15 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Deletion of /opt/stack/data/nova/instances/eed8cea5-9e5c-4467-8993-456cb3235fd8_del complete
Apr 11 23:18:15 user nova-compute[71516]: INFO nova.compute.manager [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 11 23:18:15 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:18:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:16 user nova-compute[71516]: INFO nova.compute.manager [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Terminating instance
Apr 11 23:18:16 user nova-compute[71516]: DEBUG nova.compute.manager [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:16 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Took 0.73 seconds to deallocate network for instance.
Apr 11 23:18:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-a9f6990c-f09e-4818-99ad-8b8ab5a313c8 req-f580fbf0-8857-4398-8179-cffa697465b8 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-deleted-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:16 user nova-compute[71516]: INFO nova.compute.manager [req-a9f6990c-f09e-4818-99ad-8b8ab5a313c8 req-f580fbf0-8857-4398-8179-cffa697465b8 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Neutron deleted interface 961d8195-c0d7-49eb-bfd7-05ee4b3e6112; detaching it from the instance and deleting it from the info cache
Apr 11 23:18:16 user nova-compute[71516]: DEBUG nova.network.neutron [req-a9f6990c-f09e-4818-99ad-8b8ab5a313c8 req-f580fbf0-8857-4398-8179-cffa697465b8 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-a9f6990c-f09e-4818-99ad-8b8ab5a313c8 req-f580fbf0-8857-4398-8179-cffa697465b8 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Detach interface failed, port_id=961d8195-c0d7-49eb-bfd7-05ee4b3e6112, reason: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:16 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] Instance destroyed successfully.
Apr 11 23:18:16 user nova-compute[71516]: DEBUG nova.objects.instance [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'resources' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-306537180',display_name='tempest-AttachVolumeTestJSON-server-306537180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-306537180',id=16,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBCZV7mfgey8l84oWxyLPmpf/vUdIecbJfbZusGcLaLsUyVaAO/eUu8uumuNjaCqYf3u0A6YOPq2RC4XZqaH6cL8LKWE4mILFzbc1EBe4QFoOM0qAj4Mr6qKrIzOcb4DQ==',key_name='tempest-keypair-759307061',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0ff3d48596a44f8ac8d9306becd8178',ramdisk_id='',reservation_id='r-75uy56ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-343820803',owner_user_name='tempest-AttachVolumeTestJSON-343820803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:16:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1793cec543e8425899474614b2c10f5d',uuid=e4d31874-4273-48bc-8811-89832d18b893,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converting VIF {"id": "ac90e400-803b-41b5-b183-f93bfbf297b6", "address": "fa:16:3e:f7:1e:78", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac90e400-80", "ovs_interfaceid": "ac90e400-803b-41b5-b183-f93bfbf297b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG os_vif [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac90e400-80, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:16 user nova-compute[71516]: INFO os_vif [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1e:78,bridge_name='br-int',has_traffic_filtering=True,id=ac90e400-803b-41b5-b183-f93bfbf297b6,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac90e400-80')
Apr 11 23:18:16 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Deleting instance files /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893_del
Apr 11 23:18:16 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Deletion of /opt/stack/data/nova/instances/e4d31874-4273-48bc-8811-89832d18b893_del complete
Apr 11 23:18:17 user nova-compute[71516]: INFO nova.compute.manager [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:18:17 user nova-compute[71516]: INFO nova.compute.manager [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Took 1.00 seconds to detach 1 volumes for instance.
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Acquiring lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] No waiting events found dispatching network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:18:17 user nova-compute[71516]: WARNING nova.compute.manager [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Received unexpected event network-vif-plugged-961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance with vm_state active and task_state deleting.
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-unplugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] No waiting events found dispatching network-vif-unplugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-unplugged-ac90e400-803b-41b5-b183-f93bfbf297b6 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Acquiring lock "e4d31874-4273-48bc-8811-89832d18b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Lock "e4d31874-4273-48bc-8811-89832d18b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] No waiting events found dispatching network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:18:17 user nova-compute[71516]: WARNING nova.compute.manager [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received unexpected event network-vif-plugged-ac90e400-803b-41b5-b183-f93bfbf297b6 for instance with vm_state active and task_state deleting.
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255082.698155, 8d9f6a0d-caab-4f42-a9b1-a4653b90559f => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:18:17 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] VM Stopped (Lifecycle Event)
Apr 11 23:18:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ac6570c4-6bcf-4392-bf02-1c4816cdb882 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:18:17 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Deleted allocations for instance eed8cea5-9e5c-4467-8993-456cb3235fd8
Apr 11 23:18:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "eed8cea5-9e5c-4467-8993-456cb3235fd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.306s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:17 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:17 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] Took 0.96 seconds to deallocate network for instance.
Apr 11 23:18:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:18 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:18:18 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:18:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:18 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Deleted allocations for instance e4d31874-4273-48bc-8811-89832d18b893
Apr 11 23:18:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "e4d31874-4273-48bc-8811-89832d18b893" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.215s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-c4b2e059-862e-4f38-a0cd-f9a36c62835c req-5859fb2d-36a4-4b0a-bd31-84fe73486327 service nova] [instance: e4d31874-4273-48bc-8811-89832d18b893] Received event network-vif-deleted-ac90e400-803b-41b5-b183-f93bfbf297b6 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:23 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255088.16038, f1a98583-cd58-4078-999f-f2bfb3a50c48 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:18:23 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] VM Stopped (Lifecycle Event)
Apr 11 23:18:23 user nova-compute[71516]: DEBUG nova.compute.manager [None req-8b1ae3ac-c158-47d6-8eee-ce77211235a9 None None] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:18:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Received event network-changed-251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Refreshing instance network info cache due to event network-changed-251c2317-e6a3-40d8-849b-bec8357be943. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:18:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] Acquiring lock "refresh_cache-f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:18:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] Acquired lock "refresh_cache-f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:18:24 user nova-compute[71516]: DEBUG nova.network.neutron [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Refreshing network info cache for port 251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:18:25 user nova-compute[71516]: DEBUG nova.network.neutron [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Updated VIF entry in instance network info cache for port 251c2317-e6a3-40d8-849b-bec8357be943. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:18:25 user nova-compute[71516]: DEBUG nova.network.neutron [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Updating instance_info_cache with network_info: [{"id": "251c2317-e6a3-40d8-849b-bec8357be943", "address": "fa:16:3e:c4:c9:7b", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251c2317-e6", "ovs_interfaceid": "251c2317-e6a3-40d8-849b-bec8357be943", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] Releasing lock "refresh_cache-f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:18:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "90fabe62-030d-46f9-ba2f-0f484e987022" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "90fabe62-030d-46f9-ba2f-0f484e987022" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:28 user nova-compute[71516]: DEBUG nova.compute.manager [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:18:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:18:29 user nova-compute[71516]: INFO nova.compute.claims [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Claim successful on node user
Apr 11 23:18:29 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG nova.network.neutron [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:18:29 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:18:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:18:29 user nova-compute[71516]: INFO nova.virt.block_device [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Booting with volume c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 at /dev/vda
Apr 11 23:18:29 user nova-compute[71516]: DEBUG nova.policy [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG os_brick.utils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[de49a97f-1585-4132-b225-e536e57d334e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9938c836-e090-4304-a51c-8d5febb10bb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[18957dbc-3c39-43b5-a2f3-5c28068490a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1773bf-28cc-43e2-9b86-a2087ad36ff1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:18:29 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:18:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[deeed4d0-99c7-41d1-81d9-1ef81ed2c440]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG os_brick.utils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:18:29 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Updating existing volume attachment record: d26aa2c4-c9e7-41e4-8aff-f8172a535618 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:18:30 user nova-compute[71516]: DEBUG nova.network.neutron [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Successfully created port: 5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:18:30 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:18:30 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255095.2620685, eed8cea5-9e5c-4467-8993-456cb3235fd8 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:18:30 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] VM Stopped (Lifecycle Event)
Apr 11 23:18:30 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7787823e-1bbb-4348-92bf-eca10c0baa89 None None] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:18:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:30 user nova-compute[71516]: DEBUG nova.network.neutron [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Successfully updated port: 5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:18:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "refresh_cache-90fabe62-030d-46f9-ba2f-0f484e987022" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:18:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquired lock "refresh_cache-90fabe62-030d-46f9-ba2f-0f484e987022" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:18:30 user nova-compute[71516]: DEBUG nova.network.neutron [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:18:30 user nova-compute[71516]: DEBUG nova.compute.manager [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Received event network-changed-5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:30 user nova-compute[71516]: DEBUG nova.compute.manager [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Refreshing instance network info cache due to event network-changed-5602a828-929f-4fd6-bd61-f4d5717f6ca4. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:18:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] Acquiring lock "refresh_cache-90fabe62-030d-46f9-ba2f-0f484e987022" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:18:30 user nova-compute[71516]: DEBUG nova.network.neutron [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:18:31 user nova-compute[71516]: DEBUG nova.network.neutron [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Updating instance_info_cache with network_info: [{"id": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "address": "fa:16:3e:df:d3:22", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5602a828-92", "ovs_interfaceid": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Releasing lock "refresh_cache-90fabe62-030d-46f9-ba2f-0f484e987022" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:18:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Instance network_info: |[{"id": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "address": "fa:16:3e:df:d3:22", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5602a828-92", "ovs_interfaceid": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:18:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] Acquired lock "refresh_cache-90fabe62-030d-46f9-ba2f-0f484e987022" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:18:31 user nova-compute[71516]: DEBUG nova.network.neutron [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Refreshing network info cache for port 5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:18:31 user nova-compute[71516]: DEBUG nova.network.neutron [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Updated VIF entry in instance network info cache for port 5602a828-929f-4fd6-bd61-f4d5717f6ca4. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:18:31 user nova-compute[71516]: DEBUG nova.network.neutron [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Updating instance_info_cache with network_info: [{"id": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "address": "fa:16:3e:df:d3:22", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5602a828-92", "ovs_interfaceid": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] Releasing lock "refresh_cache-90fabe62-030d-46f9-ba2f-0f484e987022" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:18:31 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255096.9180555, e4d31874-4273-48bc-8811-89832d18b893 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:18:31 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: e4d31874-4273-48bc-8811-89832d18b893] VM Stopped (Lifecycle Event)
Apr 11 23:18:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9ec50a41-3e10-4f47-b8e0-e6798828731a None None] [instance: e4d31874-4273-48bc-8811-89832d18b893] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:18:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Updating instance_info_cache with network_info: [{"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:18:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:18:34 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Creating image(s)
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Ensure instance console log exists: /opt/stack/data/nova/instances/90fabe62-030d-46f9-ba2f-0f484e987022/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Start _get_guest_xml network_info=[{"id": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "address": "fa:16:3e:df:d3:22", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5602a828-92", "ovs_interfaceid": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWpvPATi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90fabe62-030d-46f9-ba2f-0f484e987022', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4', 'serial': 'c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4'}, 'disk_bus': 'virtio', 'attachment_id': 'd26aa2c4-c9e7-41e4-8aff-f8172a535618', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:18:34 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:18:34 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWpvPATi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:18:34 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:18:34 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:18:34 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[419afd6f-79e9-4ea3-9e77-ce8ae8bcf81a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:18:34 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c25177-e1ae-4f62-aa99-251f9babbce2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4] added
Apr 11 23:18:34 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26d6f10-eb67-4d37-833a-5cd546528af8]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa99981-b49b-4108-9ef8-c4ed3aa706f4]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWpvPATi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWpvPATi" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1958991f-b180-4028-accb-b3fca19508c5]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qWpvPATi'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7234f45-83ab-4e17-ac21-a09238b97bd9]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0deed91-1ed7-4190-b3a6-da8a8e167a9d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:34 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:34 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[69be4978-7516-4a1b-af43-0cfa5febf7dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4, portal: 172.16.0.220,3260]
Apr 11 23:18:34 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4, portal: 172.16.0.220,3260] successful.
Apr 11 23:18:34 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2ebe18-e3f2-4e92-89bd-aa6c184ce3c8]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a7a187-6dda-4415-b9e1-15d72c38cb19]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:34 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:18:34 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:34 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:18:34 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b3e63e-861e-47aa-b0b0-0049b18ecfb0]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWpvPATi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.710s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== connect_volume: return (711ms) {'type': 'block', 'scsi_wwn': '23237656436333339', 'path': '/dev/sdb'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237656436333339', 'path': '/dev/sdb'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:18:34 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:18:34 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8267MB free_disk=26.263816833496094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1048278755',display_name='tempest-TestVolumeBootPattern-server-1048278755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1048278755',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTeA7e6j/wrChwM1jogClH0JWZ33jOggStHh7lL1aQsrNXULlUHFl3iqjE9etghhRnMsyLyd4JqIILvNvoCcqVmiQ5foShdj8Q9wa2sI4sRIJCvJ4hRZ+cCGZXsMJkWw==',key_name='tempest-TestVolumeBootPattern-15540354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-rsa2f0lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:18:29Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=90fabe62-030d-46f9-ba2f-0f484e987022,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "address": "fa:16:3e:df:d3:22", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5602a828-92", "ovs_interfaceid": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "address": "fa:16:3e:df:d3:22", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5602a828-92", "ovs_interfaceid": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d3:22,bridge_name='br-int',has_traffic_filtering=True,id=5602a828-929f-4fd6-bd61-f4d5717f6ca4,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5602a828-92') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.objects.instance [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lazy-loading 'pci_devices' on Instance uuid 90fabe62-030d-46f9-ba2f-0f484e987022 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:18:34 user nova-compute[71516]:   <uuid>90fabe62-030d-46f9-ba2f-0f484e987022</uuid>
Apr 11 23:18:34 user nova-compute[71516]:   <name>instance-0000001f</name>
Apr 11 23:18:34 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:18:34 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:18:34 user nova-compute[71516]:   <metadata>
Apr 11 23:18:34 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:18:34 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:18:34 user nova-compute[71516]:       <nova:name>tempest-TestVolumeBootPattern-server-1048278755</nova:name>
Apr 11 23:18:34 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:18:34</nova:creationTime>
Apr 11 23:18:34 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:18:34 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:18:34 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:18:34 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:18:34 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:18:34 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:18:34 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:18:34 user nova-compute[71516]:       <nova:owner>
Apr 11 23:18:34 user nova-compute[71516]:         <nova:user uuid="589c07cd12e849cfa38423959e76c695">tempest-TestVolumeBootPattern-365588456-project-member</nova:user>
Apr 11 23:18:34 user nova-compute[71516]:         <nova:project uuid="f6700d66136e4f9590658e3103cceac8">tempest-TestVolumeBootPattern-365588456</nova:project>
Apr 11 23:18:34 user nova-compute[71516]:       </nova:owner>
Apr 11 23:18:34 user nova-compute[71516]:       <nova:ports>
Apr 11 23:18:34 user nova-compute[71516]:         <nova:port uuid="5602a828-929f-4fd6-bd61-f4d5717f6ca4">
Apr 11 23:18:34 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 23:18:34 user nova-compute[71516]:         </nova:port>
Apr 11 23:18:34 user nova-compute[71516]:       </nova:ports>
Apr 11 23:18:34 user nova-compute[71516]:     </nova:instance>
Apr 11 23:18:34 user nova-compute[71516]:   </metadata>
Apr 11 23:18:34 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:18:34 user nova-compute[71516]:     <system>
Apr 11 23:18:34 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:18:34 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:18:34 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:18:34 user nova-compute[71516]:       <entry name="serial">90fabe62-030d-46f9-ba2f-0f484e987022</entry>
Apr 11 23:18:34 user nova-compute[71516]:       <entry name="uuid">90fabe62-030d-46f9-ba2f-0f484e987022</entry>
Apr 11 23:18:34 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:18:34 user nova-compute[71516]:     </system>
Apr 11 23:18:34 user nova-compute[71516]:   </sysinfo>
Apr 11 23:18:34 user nova-compute[71516]:   <os>
Apr 11 23:18:34 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:18:34 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:18:34 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:18:34 user nova-compute[71516]:   </os>
Apr 11 23:18:34 user nova-compute[71516]:   <features>
Apr 11 23:18:34 user nova-compute[71516]:     <acpi/>
Apr 11 23:18:34 user nova-compute[71516]:     <apic/>
Apr 11 23:18:34 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:18:34 user nova-compute[71516]:   </features>
Apr 11 23:18:34 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:18:34 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:18:34 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:18:34 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:18:34 user nova-compute[71516]:   </clock>
Apr 11 23:18:34 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:18:34 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:18:34 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:18:34 user nova-compute[71516]:   </cpu>
Apr 11 23:18:34 user nova-compute[71516]:   <devices>
Apr 11 23:18:34 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:18:34 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:18:34 user nova-compute[71516]:       <source dev="/dev/sdb"/>
Apr 11 23:18:34 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:18:34 user nova-compute[71516]:       <serial>c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4</serial>
Apr 11 23:18:34 user nova-compute[71516]:     </disk>
Apr 11 23:18:34 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:18:34 user nova-compute[71516]:       <mac address="fa:16:3e:df:d3:22"/>
Apr 11 23:18:34 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:18:34 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:18:34 user nova-compute[71516]:       <target dev="tap5602a828-92"/>
Apr 11 23:18:34 user nova-compute[71516]:     </interface>
Apr 11 23:18:34 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:18:34 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/90fabe62-030d-46f9-ba2f-0f484e987022/console.log" append="off"/>
Apr 11 23:18:34 user nova-compute[71516]:     </serial>
Apr 11 23:18:34 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:18:34 user nova-compute[71516]:     <video>
Apr 11 23:18:34 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:18:34 user nova-compute[71516]:     </video>
Apr 11 23:18:34 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:18:34 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:18:34 user nova-compute[71516]:     </rng>
Apr 11 23:18:34 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:18:34 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:18:34 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:18:34 user nova-compute[71516]:     </memballoon>
Apr 11 23:18:34 user nova-compute[71516]:   </devices>
Apr 11 23:18:34 user nova-compute[71516]: </domain>
Apr 11 23:18:34 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1048278755',display_name='tempest-TestVolumeBootPattern-server-1048278755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1048278755',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTeA7e6j/wrChwM1jogClH0JWZ33jOggStHh7lL1aQsrNXULlUHFl3iqjE9etghhRnMsyLyd4JqIILvNvoCcqVmiQ5foShdj8Q9wa2sI4sRIJCvJ4hRZ+cCGZXsMJkWw==',key_name='tempest-TestVolumeBootPattern-15540354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-rsa2f0lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:18:29Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=90fabe62-030d-46f9-ba2f-0f484e987022,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "address": "fa:16:3e:df:d3:22", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5602a828-92", "ovs_interfaceid": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "address": "fa:16:3e:df:d3:22", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5602a828-92", "ovs_interfaceid": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d3:22,bridge_name='br-int',has_traffic_filtering=True,id=5602a828-929f-4fd6-bd61-f4d5717f6ca4,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5602a828-92') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG os_vif [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d3:22,bridge_name='br-int',has_traffic_filtering=True,id=5602a828-929f-4fd6-bd61-f4d5717f6ca4,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5602a828-92') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5602a828-92, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5602a828-92, col_values=(('external_ids', {'iface-id': '5602a828-929f-4fd6-bd61-f4d5717f6ca4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:d3:22', 'vm-uuid': '90fabe62-030d-46f9-ba2f-0f484e987022'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:34 user nova-compute[71516]: INFO os_vif [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d3:22,bridge_name='br-int',has_traffic_filtering=True,id=5602a828-929f-4fd6-bd61-f4d5717f6ca4,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5602a828-92')
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 90fabe62-030d-46f9-ba2f-0f484e987022 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:18:34 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:18:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:18:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] No VIF found with MAC fa:16:3e:df:d3:22, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:18:35 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:18:35 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:18:35 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:18:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-7a960c21-ca86-489e-a1b2-d5814c189e5a req-dd7df528-2f4f-4bc0-bff0-120ea48d6f94 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Received event network-vif-plugged-5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7a960c21-ca86-489e-a1b2-d5814c189e5a req-dd7df528-2f4f-4bc0-bff0-120ea48d6f94 service nova] Acquiring lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7a960c21-ca86-489e-a1b2-d5814c189e5a req-dd7df528-2f4f-4bc0-bff0-120ea48d6f94 service nova] Lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7a960c21-ca86-489e-a1b2-d5814c189e5a req-dd7df528-2f4f-4bc0-bff0-120ea48d6f94 service nova] Lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-7a960c21-ca86-489e-a1b2-d5814c189e5a req-dd7df528-2f4f-4bc0-bff0-120ea48d6f94 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] No waiting events found dispatching network-vif-plugged-5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:18:36 user nova-compute[71516]: WARNING nova.compute.manager [req-7a960c21-ca86-489e-a1b2-d5814c189e5a req-dd7df528-2f4f-4bc0-bff0-120ea48d6f94 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Received unexpected event network-vif-plugged-5602a828-929f-4fd6-bd61-f4d5717f6ca4 for instance with vm_state building and task_state spawning.
Apr 11 23:18:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255118.289087, 90fabe62-030d-46f9-ba2f-0f484e987022 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:18:38 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] VM Resumed (Lifecycle Event)
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.compute.manager [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:18:38 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Instance spawned successfully.
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'flavor' on Instance uuid 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:18:38 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255118.2894669, 90fabe62-030d-46f9-ba2f-0f484e987022 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:18:38 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] VM Started (Lifecycle Event)
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:18:38 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:18:38 user nova-compute[71516]: INFO nova.compute.manager [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Took 4.35 seconds to spawn the instance on the hypervisor.
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.compute.manager [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-1478a0f5-c9ac-4e13-a0d9-2f9b3cead0ac req-cde6a79d-4a76-449d-9735-42c5df1135ad service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Received event network-vif-plugged-5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1478a0f5-c9ac-4e13-a0d9-2f9b3cead0ac req-cde6a79d-4a76-449d-9735-42c5df1135ad service nova] Acquiring lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1478a0f5-c9ac-4e13-a0d9-2f9b3cead0ac req-cde6a79d-4a76-449d-9735-42c5df1135ad service nova] Lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1478a0f5-c9ac-4e13-a0d9-2f9b3cead0ac req-cde6a79d-4a76-449d-9735-42c5df1135ad service nova] Lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-1478a0f5-c9ac-4e13-a0d9-2f9b3cead0ac req-cde6a79d-4a76-449d-9735-42c5df1135ad service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] No waiting events found dispatching network-vif-plugged-5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:18:38 user nova-compute[71516]: WARNING nova.compute.manager [req-1478a0f5-c9ac-4e13-a0d9-2f9b3cead0ac req-cde6a79d-4a76-449d-9735-42c5df1135ad service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Received unexpected event network-vif-plugged-5602a828-929f-4fd6-bd61-f4d5717f6ca4 for instance with vm_state building and task_state spawning.
Apr 11 23:18:38 user nova-compute[71516]: INFO nova.compute.manager [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Took 9.56 seconds to build instance.
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:38 user nova-compute[71516]: INFO nova.compute.manager [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Attaching volume 5c7fe861-90c1-4630-a64a-73b40239df5e to /dev/vdb
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "90fabe62-030d-46f9-ba2f-0f484e987022" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.673s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG os_brick.utils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f240440-ba6e-40cf-8d73-55d4090a88e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e324acf5-b060-48cc-9c0a-2ca79cdbd9c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d126537-ae6f-491d-adc9-6c0b5e80d10a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a130973-c1b6-4892-a295-40ead5bfd04a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:18:38 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:18:38 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa23b697-ac2f-4e63-af92-cee810dbbb8d]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG os_brick.utils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:18:38 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updating existing volume attachment record: 6b3913d4-7ea5-4480-a0ed-e7f84e225ec5 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:18:39 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:18:39 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:18:39 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:18:39 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:18:39 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:18:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:18:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHRPXdFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:18:43 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:18:43 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:18:43 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1a6ee0-ddbd-4617-b745-a0a685fbee61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:18:43 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d989cb-4918-4263-b2b7-5d70eb1ca3c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e] added
Apr 11 23:18:43 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f062827-6a4c-49ea-b36f-38d0070eb748]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2972363a-8e22-4ed9-aef8-8324c76fd6b6]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VHRPXdFp {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VHRPXdFp" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec33287-d2d1-473a-b37c-3b2acece1e7c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VHRPXdFp'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d708b481-320f-4f89-aa06-c5292daddb67]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6503de-8266-4d28-927e-ee1b321d6e8f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:43 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:18:43 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:43 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:18:43 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12388e9-9709-4a0d-a03f-e483bd631421]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260]
Apr 11 23:18:43 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260] successful.
Apr 11 23:18:43 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a86fd89-787d-4227-b7f0-354853d5d09d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e30e073-30d5-424b-8341-ea1eb61691ad]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:43 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:18:43 user nova-compute[71516]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:18:43 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:43 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:18:43 user nova-compute[71516]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:18:43 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b26102-25e8-4260-bda6-d12ca1f8cf9a]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:18:43 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHRPXdFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:18:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:18:44 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26666356634396339', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:18:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666356634396339', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:18:44 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'flavor' on Instance uuid 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:18:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:18:44 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:18:44 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:18:44 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:18:44 user nova-compute[71516]:   <serial>5c7fe861-90c1-4630-a64a-73b40239df5e</serial>
Apr 11 23:18:44 user nova-compute[71516]: </disk>
Apr 11 23:18:44 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:18:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:18:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:18:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] No VIF found with MAC fa:16:3e:41:3b:05, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:18:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.518s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:49 user nova-compute[71516]: DEBUG nova.compute.manager [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-changed-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:49 user nova-compute[71516]: DEBUG nova.compute.manager [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Refreshing instance network info cache due to event network-changed-86961f23-bd39-44da-8ad9-4420b80e9223. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:18:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] Acquiring lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:18:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] Acquired lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:18:49 user nova-compute[71516]: DEBUG nova.network.neutron [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Refreshing network info cache for port 86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:18:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:50 user nova-compute[71516]: DEBUG nova.network.neutron [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updated VIF entry in instance network info cache for port 86961f23-bd39-44da-8ad9-4420b80e9223. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:18:50 user nova-compute[71516]: DEBUG nova.network.neutron [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updating instance_info_cache with network_info: [{"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] Releasing lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:18:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-changed-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Refreshing instance network info cache due to event network-changed-86961f23-bd39-44da-8ad9-4420b80e9223. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:18:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] Acquiring lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:18:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] Acquired lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:18:51 user nova-compute[71516]: DEBUG nova.network.neutron [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Refreshing network info cache for port 86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:18:51 user nova-compute[71516]: DEBUG nova.network.neutron [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updated VIF entry in instance network info cache for port 86961f23-bd39-44da-8ad9-4420b80e9223. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:18:51 user nova-compute[71516]: DEBUG nova.network.neutron [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updating instance_info_cache with network_info: [{"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] Releasing lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:53 user nova-compute[71516]: INFO nova.compute.manager [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Rebooting instance
Apr 11 23:18:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquired lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updating instance_info_cache with network_info: [{"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Releasing lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-dd7a19fa-0af3-4310-b412-25eb00277470 req-feaf0f2e-6cf7-4e45-8f22-159b7a8238c3 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-vif-unplugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dd7a19fa-0af3-4310-b412-25eb00277470 req-feaf0f2e-6cf7-4e45-8f22-159b7a8238c3 service nova] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dd7a19fa-0af3-4310-b412-25eb00277470 req-feaf0f2e-6cf7-4e45-8f22-159b7a8238c3 service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-dd7a19fa-0af3-4310-b412-25eb00277470 req-feaf0f2e-6cf7-4e45-8f22-159b7a8238c3 service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-dd7a19fa-0af3-4310-b412-25eb00277470 req-feaf0f2e-6cf7-4e45-8f22-159b7a8238c3 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] No waiting events found dispatching network-vif-unplugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:18:53 user nova-compute[71516]: WARNING nova.compute.manager [req-dd7a19fa-0af3-4310-b412-25eb00277470 req-feaf0f2e-6cf7-4e45-8f22-159b7a8238c3 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received unexpected event network-vif-unplugged-86961f23-bd39-44da-8ad9-4420b80e9223 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 23:18:54 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Instance destroyed successfully.
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'resources' on Instance uuid 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1117768809',display_name='tempest-TestMinimumBasicScenario-server-1117768809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1117768809',id=30,image_ref='61c0c235-6d9e-44b6-aaf7-5005b1f3aba4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTEcgl/NhGv4Bb/P05E6qwS4i7frnTq227Fw8NjjabwTORj5LZJIXHiu7YOkH/BFyO3Oi3ku/v20lt1w55I01gZuEaexPUI/f5ofEy7HOCw5kg1vykKtzfwLhsywN4pww==',key_name='tempest-TestMinimumBasicScenario-1640213672',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e8e126b69d44b27a60c421b86b79e9f',ramdisk_id='',reservation_id='r-p37n1zc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61c0c235-6d9e-44b6-aaf7-5005b1f3aba4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1152745105',owner_user_name='tempest-TestMinimumBasicScenario-1152745105-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:18:54Z,user_data=None,user_id='6beb3cae81a14fa2bae48a8eedcb3868',uuid=1fec2e5a-e0bf-435d-822b-766c8c2f2d9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converting VIF {"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_vif [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86961f23-bd, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:18:54 user nova-compute[71516]: INFO os_vif [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd')
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHRPXdFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:18:54 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5881265b-e898-46d7-8287-2984e6653796]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:18:54 user nova-compute[71516]: No targets found.
Apr 11 23:18:54 user nova-compute[71516]: iSNS:
Apr 11 23:18:54 user nova-compute[71516]: No targets found.
Apr 11 23:18:54 user nova-compute[71516]: STATIC:
Apr 11 23:18:54 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e
Apr 11 23:18:54 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:18:54 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:18:54 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4
Apr 11 23:18:54 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:18:54 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:18:54 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd
Apr 11 23:18:54 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:18:54 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:18:54 user nova-compute[71516]: FIRMWARE:
Apr 11 23:18:54 user nova-compute[71516]: No targets found.
Apr 11 23:18:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:18:54 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:18:54 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e19a62-c44e-4c09-85d3-8fd96945f6cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[834c375b-3026-4b95-b9e5-da9cac202067]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:54 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:18:54 user nova-compute[71516]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:18:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:54 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:18:54 user nova-compute[71516]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:18:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c79c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[03233fc0-5234-4c36-a173-29cd248e0065]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f435641a-309f-476c-985c-e8ddcf8f3c67]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5560abe4-00da-468d-975e-a7d6ec76c3dd]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b074dc9-f66d-4759-9abd-1025f6abaac9]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7e841f-830e-4b3b-8636-6dc457e8519f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd449ce4-99bb-4245-ac2e-0d5ff68edef2]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260]
Apr 11 23:18:54 user nova-compute[71516]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260] successful.
Apr 11 23:18:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b25c370-b8e2-4eca-b622-8b98f89a1e69]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] <== disconnect_volume: return (321ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Start _get_guest_xml network_info=[{"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61c0c235-6d9e-44b6-aaf7-5005b1f3aba4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '61c0c235-6d9e-44b6-aaf7-5005b1f3aba4'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHRPXdFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1fec2e5a-e0bf-435d-822b-766c8c2f2d9c', 'attached_at': '', 'detached_at': '', 'volume_id': '5c7fe861-90c1-4630-a64a-73b40239df5e', 'serial': '5c7fe861-90c1-4630-a64a-73b40239df5e'}, 'disk_bus': 'virtio', 'attachment_id': '6b3913d4-7ea5-4480-a0ed-e7f84e225ec5', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:18:54 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:18:54 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61c0c235-6d9e-44b6-aaf7-5005b1f3aba4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHRPXdFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:18:54 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:18:54 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:18:54 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3147a1e9-220c-4e24-8f95-02877a4ba411]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:18:54 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa32ca3-29c3-4cc0-aed9-107f6f3c9cfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e] added
Apr 11 23:18:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[52535c4e-935f-4c6e-96ce-072a9884cfae]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[34deb35d-e818-47d8-8009-976d5762625d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VHRPXdFp {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VHRPXdFp" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bd07f9-1738-480e-8059-8c0ed8741f19]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VHRPXdFp'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8af3656-94c8-4233-a7f4-7bafab2dedd6]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2802579d-c0db-445f-9580-747d190bb512]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:54 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:18:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:54 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:18:54 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:18:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8578ae24-d9de-4f47-9f1e-4f4b317f06d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260]
Apr 11 23:18:55 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260] successful.
Apr 11 23:18:55 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbd6bf1-3bf4-411c-88ff-f57f6f600b7f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b09afd-1d55-4d9c-ae8c-9ae7cae43b78]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:55 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:18:55 user nova-compute[71516]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:18:55 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:18:55 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:18:55 user nova-compute[71516]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:18:55 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a769828-467f-4a31-ad9f-8f4c5b82db22]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-b38d43d4-91c7-40cb-9047-e3d44ba383ce req-c46b9df7-03e0-4074-9bea-29f348a54654 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b38d43d4-91c7-40cb-9047-e3d44ba383ce req-c46b9df7-03e0-4074-9bea-29f348a54654 service nova] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b38d43d4-91c7-40cb-9047-e3d44ba383ce req-c46b9df7-03e0-4074-9bea-29f348a54654 service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b38d43d4-91c7-40cb-9047-e3d44ba383ce req-c46b9df7-03e0-4074-9bea-29f348a54654 service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-b38d43d4-91c7-40cb-9047-e3d44ba383ce req-c46b9df7-03e0-4074-9bea-29f348a54654 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] No waiting events found dispatching network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:18:55 user nova-compute[71516]: WARNING nova.compute.manager [req-b38d43d4-91c7-40cb-9047-e3d44ba383ce req-c46b9df7-03e0-4074-9bea-29f348a54654 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received unexpected event network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 23:18:56 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHRPXdFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26666356634396339', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666356634396339', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1117768809',display_name='tempest-TestMinimumBasicScenario-server-1117768809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1117768809',id=30,image_ref='61c0c235-6d9e-44b6-aaf7-5005b1f3aba4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTEcgl/NhGv4Bb/P05E6qwS4i7frnTq227Fw8NjjabwTORj5LZJIXHiu7YOkH/BFyO3Oi3ku/v20lt1w55I01gZuEaexPUI/f5ofEy7HOCw5kg1vykKtzfwLhsywN4pww==',key_name='tempest-TestMinimumBasicScenario-1640213672',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e8e126b69d44b27a60c421b86b79e9f',ramdisk_id='',reservation_id='r-p37n1zc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61c0c235-6d9e-44b6-aaf7-5005b1f3aba4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1152745105',owner_user_name='tempest-TestMinimumBasicScenario-1152745105-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:18:54Z,user_data=None,user_id='6beb3cae81a14fa2bae48a8eedcb3868',uuid=1fec2e5a-e0bf-435d-822b-766c8c2f2d9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converting VIF {"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:18:56 user nova-compute[71516]:   <uuid>1fec2e5a-e0bf-435d-822b-766c8c2f2d9c</uuid>
Apr 11 23:18:56 user nova-compute[71516]:   <name>instance-0000001e</name>
Apr 11 23:18:56 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:18:56 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:18:56 user nova-compute[71516]:   <metadata>
Apr 11 23:18:56 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:18:56 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:18:56 user nova-compute[71516]:       <nova:name>tempest-TestMinimumBasicScenario-server-1117768809</nova:name>
Apr 11 23:18:56 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:18:54</nova:creationTime>
Apr 11 23:18:56 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:18:56 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:18:56 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:18:56 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:18:56 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:18:56 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:18:56 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:18:56 user nova-compute[71516]:       <nova:owner>
Apr 11 23:18:56 user nova-compute[71516]:         <nova:user uuid="6beb3cae81a14fa2bae48a8eedcb3868">tempest-TestMinimumBasicScenario-1152745105-project-member</nova:user>
Apr 11 23:18:56 user nova-compute[71516]:         <nova:project uuid="9e8e126b69d44b27a60c421b86b79e9f">tempest-TestMinimumBasicScenario-1152745105</nova:project>
Apr 11 23:18:56 user nova-compute[71516]:       </nova:owner>
Apr 11 23:18:56 user nova-compute[71516]:       <nova:root type="image" uuid="61c0c235-6d9e-44b6-aaf7-5005b1f3aba4"/>
Apr 11 23:18:56 user nova-compute[71516]:       <nova:ports>
Apr 11 23:18:56 user nova-compute[71516]:         <nova:port uuid="86961f23-bd39-44da-8ad9-4420b80e9223">
Apr 11 23:18:56 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 23:18:56 user nova-compute[71516]:         </nova:port>
Apr 11 23:18:56 user nova-compute[71516]:       </nova:ports>
Apr 11 23:18:56 user nova-compute[71516]:     </nova:instance>
Apr 11 23:18:56 user nova-compute[71516]:   </metadata>
Apr 11 23:18:56 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:18:56 user nova-compute[71516]:     <system>
Apr 11 23:18:56 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:18:56 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:18:56 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:18:56 user nova-compute[71516]:       <entry name="serial">1fec2e5a-e0bf-435d-822b-766c8c2f2d9c</entry>
Apr 11 23:18:56 user nova-compute[71516]:       <entry name="uuid">1fec2e5a-e0bf-435d-822b-766c8c2f2d9c</entry>
Apr 11 23:18:56 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:18:56 user nova-compute[71516]:     </system>
Apr 11 23:18:56 user nova-compute[71516]:   </sysinfo>
Apr 11 23:18:56 user nova-compute[71516]:   <os>
Apr 11 23:18:56 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:18:56 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:18:56 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:18:56 user nova-compute[71516]:   </os>
Apr 11 23:18:56 user nova-compute[71516]:   <features>
Apr 11 23:18:56 user nova-compute[71516]:     <acpi/>
Apr 11 23:18:56 user nova-compute[71516]:     <apic/>
Apr 11 23:18:56 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:18:56 user nova-compute[71516]:   </features>
Apr 11 23:18:56 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:18:56 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:18:56 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:18:56 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:18:56 user nova-compute[71516]:   </clock>
Apr 11 23:18:56 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:18:56 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:18:56 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:18:56 user nova-compute[71516]:   </cpu>
Apr 11 23:18:56 user nova-compute[71516]:   <devices>
Apr 11 23:18:56 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:18:56 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:18:56 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk"/>
Apr 11 23:18:56 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:18:56 user nova-compute[71516]:     </disk>
Apr 11 23:18:56 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:18:56 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:18:56 user nova-compute[71516]:       <source dev="/dev/sdc"/>
Apr 11 23:18:56 user nova-compute[71516]:       <target dev="vdb" bus="virtio"/>
Apr 11 23:18:56 user nova-compute[71516]:       <serial>5c7fe861-90c1-4630-a64a-73b40239df5e</serial>
Apr 11 23:18:56 user nova-compute[71516]:     </disk>
Apr 11 23:18:56 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:18:56 user nova-compute[71516]:       <mac address="fa:16:3e:41:3b:05"/>
Apr 11 23:18:56 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:18:56 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:18:56 user nova-compute[71516]:       <target dev="tap86961f23-bd"/>
Apr 11 23:18:56 user nova-compute[71516]:     </interface>
Apr 11 23:18:56 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:18:56 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/console.log" append="off"/>
Apr 11 23:18:56 user nova-compute[71516]:     </serial>
Apr 11 23:18:56 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:18:56 user nova-compute[71516]:     <video>
Apr 11 23:18:56 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:18:56 user nova-compute[71516]:     </video>
Apr 11 23:18:56 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:18:56 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:18:56 user nova-compute[71516]:     </rng>
Apr 11 23:18:56 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:18:56 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:18:56 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:18:56 user nova-compute[71516]:     </memballoon>
Apr 11 23:18:56 user nova-compute[71516]:   </devices>
Apr 11 23:18:56 user nova-compute[71516]: </domain>
Apr 11 23:18:56 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Cannot resize image /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'migration_context' on Instance uuid 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1117768809',display_name='tempest-TestMinimumBasicScenario-server-1117768809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1117768809',id=30,image_ref='61c0c235-6d9e-44b6-aaf7-5005b1f3aba4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTEcgl/NhGv4Bb/P05E6qwS4i7frnTq227Fw8NjjabwTORj5LZJIXHiu7YOkH/BFyO3Oi3ku/v20lt1w55I01gZuEaexPUI/f5ofEy7HOCw5kg1vykKtzfwLhsywN4pww==',key_name='tempest-TestMinimumBasicScenario-1640213672',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9e8e126b69d44b27a60c421b86b79e9f',ramdisk_id='',reservation_id='r-p37n1zc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61c0c235-6d9e-44b6-aaf7-5005b1f3aba4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1152745105',owner_user_name='tempest-TestMinimumBasicScenario-1152745105-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:18:54Z,user_data=None,user_id='6beb3cae81a14fa2bae48a8eedcb3868',uuid=1fec2e5a-e0bf-435d-822b-766c8c2f2d9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converting VIF {"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG os_vif [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86961f23-bd, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86961f23-bd, col_values=(('external_ids', {'iface-id': '86961f23-bd39-44da-8ad9-4420b80e9223', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:3b:05', 'vm-uuid': '1fec2e5a-e0bf-435d-822b-766c8c2f2d9c'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:18:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:56 user nova-compute[71516]: INFO os_vif [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd')
Apr 11 23:18:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-cc737115-b09f-4aa7-9d6d-ad69f65b9de3 req-aa50daf8-0ba8-4f04-83e5-aa64ce57679e service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:18:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cc737115-b09f-4aa7-9d6d-ad69f65b9de3 req-aa50daf8-0ba8-4f04-83e5-aa64ce57679e service nova] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:18:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cc737115-b09f-4aa7-9d6d-ad69f65b9de3 req-aa50daf8-0ba8-4f04-83e5-aa64ce57679e service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:18:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cc737115-b09f-4aa7-9d6d-ad69f65b9de3 req-aa50daf8-0ba8-4f04-83e5-aa64ce57679e service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:18:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-cc737115-b09f-4aa7-9d6d-ad69f65b9de3 req-aa50daf8-0ba8-4f04-83e5-aa64ce57679e service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] No waiting events found dispatching network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:18:58 user nova-compute[71516]: WARNING nova.compute.manager [req-cc737115-b09f-4aa7-9d6d-ad69f65b9de3 req-aa50daf8-0ba8-4f04-83e5-aa64ce57679e service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received unexpected event network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 23:18:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:18:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:19:00 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255140.3824372, 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:19:00 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] VM Resumed (Lifecycle Event)
Apr 11 23:19:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:19:00 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Instance rebooted successfully.
Apr 11 23:19:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:19:00 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 11 23:19:00 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255140.387254, 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:19:00 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] VM Started (Lifecycle Event)
Apr 11 23:19:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.424s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:19:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-696372ed-5a7c-44a8-a5b2-089d39acf35f req-9a5aea50-cb9a-4060-ba4f-0fcf7ba0de74 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-696372ed-5a7c-44a8-a5b2-089d39acf35f req-9a5aea50-cb9a-4060-ba4f-0fcf7ba0de74 service nova] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-696372ed-5a7c-44a8-a5b2-089d39acf35f req-9a5aea50-cb9a-4060-ba4f-0fcf7ba0de74 service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-696372ed-5a7c-44a8-a5b2-089d39acf35f req-9a5aea50-cb9a-4060-ba4f-0fcf7ba0de74 service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-696372ed-5a7c-44a8-a5b2-089d39acf35f req-9a5aea50-cb9a-4060-ba4f-0fcf7ba0de74 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] No waiting events found dispatching network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:19:00 user nova-compute[71516]: WARNING nova.compute.manager [req-696372ed-5a7c-44a8-a5b2-089d39acf35f req-9a5aea50-cb9a-4060-ba4f-0fcf7ba0de74 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received unexpected event network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 for instance with vm_state active and task_state None.
Apr 11 23:19:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:19:01 user nova-compute[71516]: INFO nova.compute.claims [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Claim successful on node user
Apr 11 23:19:01 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:19:01 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:19:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG nova.policy [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:19:01 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Creating image(s)
Apr 11 23:19:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "/opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "/opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.165s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.156s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk 1073741824" returned: 0 in 0.056s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.161s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Cannot resize image /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'migration_context' on Instance uuid bd78e8ee-ec6a-4de8-8146-bd37787b5c2c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Successfully created port: 79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Ensure instance console log exists: /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Successfully updated port: 79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "refresh_cache-bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquired lock "refresh_cache-bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received event network-changed-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Refreshing instance network info cache due to event network-changed-79f30c94-ec16-4a33-b97e-639ce9a383c8. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] Acquiring lock "refresh_cache-bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Updating instance_info_cache with network_info: [{"id": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "address": "fa:16:3e:17:84:71", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f30c94-ec", "ovs_interfaceid": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Releasing lock "refresh_cache-bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Instance network_info: |[{"id": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "address": "fa:16:3e:17:84:71", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f30c94-ec", "ovs_interfaceid": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] Acquired lock "refresh_cache-bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.network.neutron [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Refreshing network info cache for port 79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Start _get_guest_xml network_info=[{"id": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "address": "fa:16:3e:17:84:71", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f30c94-ec", "ovs_interfaceid": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:19:03 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:19:03 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-970474155',display_name='tempest-AttachVolumeNegativeTest-server-970474155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-970474155',id=32,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhRiArT29Rv92Wh1N2Mt98TPn5xlam31Hu8Z75IA4+J6QNB3eeaIWgcW3gwaUMUpR1wXJRGFbU5LHD1vOHhxsWwkp54eRAOxnFQP1vQNXofezaTxUI9CI1Kb2w/uTa/Qw==',key_name='tempest-keypair-1508967452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f29d28c472c4f65b8437ce443d208c7',ramdisk_id='',reservation_id='r-crctdfv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2123485934',owner_user_name='tempest-AttachVolumeNegativeTest-2123485934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:19:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da1389f3e27f49f394598636d041a9c9',uuid=bd78e8ee-ec6a-4de8-8146-bd37787b5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "address": "fa:16:3e:17:84:71", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f30c94-ec", "ovs_interfaceid": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converting VIF {"id": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "address": "fa:16:3e:17:84:71", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f30c94-ec", "ovs_interfaceid": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:71,bridge_name='br-int',has_traffic_filtering=True,id=79f30c94-ec16-4a33-b97e-639ce9a383c8,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f30c94-ec') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'pci_devices' on Instance uuid bd78e8ee-ec6a-4de8-8146-bd37787b5c2c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:19:03 user nova-compute[71516]:   <uuid>bd78e8ee-ec6a-4de8-8146-bd37787b5c2c</uuid>
Apr 11 23:19:03 user nova-compute[71516]:   <name>instance-00000020</name>
Apr 11 23:19:03 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:19:03 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:19:03 user nova-compute[71516]:   <metadata>
Apr 11 23:19:03 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:19:03 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:19:03 user nova-compute[71516]:       <nova:name>tempest-AttachVolumeNegativeTest-server-970474155</nova:name>
Apr 11 23:19:03 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:19:03</nova:creationTime>
Apr 11 23:19:03 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:19:03 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:19:03 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:19:03 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:19:03 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:19:03 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:19:03 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:19:03 user nova-compute[71516]:       <nova:owner>
Apr 11 23:19:03 user nova-compute[71516]:         <nova:user uuid="da1389f3e27f49f394598636d041a9c9">tempest-AttachVolumeNegativeTest-2123485934-project-member</nova:user>
Apr 11 23:19:03 user nova-compute[71516]:         <nova:project uuid="9f29d28c472c4f65b8437ce443d208c7">tempest-AttachVolumeNegativeTest-2123485934</nova:project>
Apr 11 23:19:03 user nova-compute[71516]:       </nova:owner>
Apr 11 23:19:03 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:19:03 user nova-compute[71516]:       <nova:ports>
Apr 11 23:19:03 user nova-compute[71516]:         <nova:port uuid="79f30c94-ec16-4a33-b97e-639ce9a383c8">
Apr 11 23:19:03 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:19:03 user nova-compute[71516]:         </nova:port>
Apr 11 23:19:03 user nova-compute[71516]:       </nova:ports>
Apr 11 23:19:03 user nova-compute[71516]:     </nova:instance>
Apr 11 23:19:03 user nova-compute[71516]:   </metadata>
Apr 11 23:19:03 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:19:03 user nova-compute[71516]:     <system>
Apr 11 23:19:03 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:19:03 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:19:03 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:19:03 user nova-compute[71516]:       <entry name="serial">bd78e8ee-ec6a-4de8-8146-bd37787b5c2c</entry>
Apr 11 23:19:03 user nova-compute[71516]:       <entry name="uuid">bd78e8ee-ec6a-4de8-8146-bd37787b5c2c</entry>
Apr 11 23:19:03 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:19:03 user nova-compute[71516]:     </system>
Apr 11 23:19:03 user nova-compute[71516]:   </sysinfo>
Apr 11 23:19:03 user nova-compute[71516]:   <os>
Apr 11 23:19:03 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:19:03 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:19:03 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:19:03 user nova-compute[71516]:   </os>
Apr 11 23:19:03 user nova-compute[71516]:   <features>
Apr 11 23:19:03 user nova-compute[71516]:     <acpi/>
Apr 11 23:19:03 user nova-compute[71516]:     <apic/>
Apr 11 23:19:03 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:19:03 user nova-compute[71516]:   </features>
Apr 11 23:19:03 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:19:03 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:19:03 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:19:03 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:19:03 user nova-compute[71516]:   </clock>
Apr 11 23:19:03 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:19:03 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:19:03 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:19:03 user nova-compute[71516]:   </cpu>
Apr 11 23:19:03 user nova-compute[71516]:   <devices>
Apr 11 23:19:03 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:19:03 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:19:03 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk"/>
Apr 11 23:19:03 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:19:03 user nova-compute[71516]:     </disk>
Apr 11 23:19:03 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:19:03 user nova-compute[71516]:       <mac address="fa:16:3e:17:84:71"/>
Apr 11 23:19:03 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:19:03 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:19:03 user nova-compute[71516]:       <target dev="tap79f30c94-ec"/>
Apr 11 23:19:03 user nova-compute[71516]:     </interface>
Apr 11 23:19:03 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:19:03 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/console.log" append="off"/>
Apr 11 23:19:03 user nova-compute[71516]:     </serial>
Apr 11 23:19:03 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:19:03 user nova-compute[71516]:     <video>
Apr 11 23:19:03 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:19:03 user nova-compute[71516]:     </video>
Apr 11 23:19:03 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:19:03 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:19:03 user nova-compute[71516]:     </rng>
Apr 11 23:19:03 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:19:03 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:19:03 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:19:03 user nova-compute[71516]:     </memballoon>
Apr 11 23:19:03 user nova-compute[71516]:   </devices>
Apr 11 23:19:03 user nova-compute[71516]: </domain>
Apr 11 23:19:03 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-970474155',display_name='tempest-AttachVolumeNegativeTest-server-970474155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-970474155',id=32,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhRiArT29Rv92Wh1N2Mt98TPn5xlam31Hu8Z75IA4+J6QNB3eeaIWgcW3gwaUMUpR1wXJRGFbU5LHD1vOHhxsWwkp54eRAOxnFQP1vQNXofezaTxUI9CI1Kb2w/uTa/Qw==',key_name='tempest-keypair-1508967452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f29d28c472c4f65b8437ce443d208c7',ramdisk_id='',reservation_id='r-crctdfv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2123485934',owner_user_name='tempest-AttachVolumeNegativeTest-2123485934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:19:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da1389f3e27f49f394598636d041a9c9',uuid=bd78e8ee-ec6a-4de8-8146-bd37787b5c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "address": "fa:16:3e:17:84:71", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f30c94-ec", "ovs_interfaceid": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converting VIF {"id": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "address": "fa:16:3e:17:84:71", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f30c94-ec", "ovs_interfaceid": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:71,bridge_name='br-int',has_traffic_filtering=True,id=79f30c94-ec16-4a33-b97e-639ce9a383c8,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f30c94-ec') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG os_vif [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:71,bridge_name='br-int',has_traffic_filtering=True,id=79f30c94-ec16-4a33-b97e-639ce9a383c8,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f30c94-ec') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79f30c94-ec, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79f30c94-ec, col_values=(('external_ids', {'iface-id': '79f30c94-ec16-4a33-b97e-639ce9a383c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:84:71', 'vm-uuid': 'bd78e8ee-ec6a-4de8-8146-bd37787b5c2c'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:03 user nova-compute[71516]: INFO os_vif [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:84:71,bridge_name='br-int',has_traffic_filtering=True,id=79f30c94-ec16-4a33-b97e-639ce9a383c8,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f30c94-ec')
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:19:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No VIF found with MAC fa:16:3e:17:84:71, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:19:04 user nova-compute[71516]: DEBUG nova.network.neutron [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Updated VIF entry in instance network info cache for port 79f30c94-ec16-4a33-b97e-639ce9a383c8. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:19:04 user nova-compute[71516]: DEBUG nova.network.neutron [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Updating instance_info_cache with network_info: [{"id": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "address": "fa:16:3e:17:84:71", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f30c94-ec", "ovs_interfaceid": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:19:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] Releasing lock "refresh_cache-bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:19:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-d323b9ce-1df1-49b9-914e-9d06f998e75b req-e750b636-d54a-4c3b-bcc2-c2c804f85a83 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received event network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d323b9ce-1df1-49b9-914e-9d06f998e75b req-e750b636-d54a-4c3b-bcc2-c2c804f85a83 service nova] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d323b9ce-1df1-49b9-914e-9d06f998e75b req-e750b636-d54a-4c3b-bcc2-c2c804f85a83 service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d323b9ce-1df1-49b9-914e-9d06f998e75b req-e750b636-d54a-4c3b-bcc2-c2c804f85a83 service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-d323b9ce-1df1-49b9-914e-9d06f998e75b req-e750b636-d54a-4c3b-bcc2-c2c804f85a83 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] No waiting events found dispatching network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:19:05 user nova-compute[71516]: WARNING nova.compute.manager [req-d323b9ce-1df1-49b9-914e-9d06f998e75b req-e750b636-d54a-4c3b-bcc2-c2c804f85a83 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received unexpected event network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance with vm_state building and task_state spawning.
Apr 11 23:19:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "e8b26dd1-48ce-476d-99e8-60001f2d7528" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:19:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:19:06 user nova-compute[71516]: INFO nova.compute.claims [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Claim successful on node user
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.network.neutron [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:19:07 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.policy [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:19:07 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Creating image(s)
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "/opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "/opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255147.692684, bd78e8ee-ec6a-4de8-8146-bd37787b5c2c => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:19:07 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] VM Resumed (Lifecycle Event)
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:07 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Instance spawned successfully.
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.165s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:07 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255147.696591, bd78e8ee-ec6a-4de8-8146-bd37787b5c2c => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:19:07 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] VM Started (Lifecycle Event)
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk 1073741824" returned: 0 in 0.068s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-48c7ef89-ed91-4308-85c2-f6092361fae0 req-38b2a93a-f046-48a0-91ef-c3e282974c70 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received event network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-48c7ef89-ed91-4308-85c2-f6092361fae0 req-38b2a93a-f046-48a0-91ef-c3e282974c70 service nova] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-48c7ef89-ed91-4308-85c2-f6092361fae0 req-38b2a93a-f046-48a0-91ef-c3e282974c70 service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-48c7ef89-ed91-4308-85c2-f6092361fae0 req-38b2a93a-f046-48a0-91ef-c3e282974c70 service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-48c7ef89-ed91-4308-85c2-f6092361fae0 req-38b2a93a-f046-48a0-91ef-c3e282974c70 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] No waiting events found dispatching network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:19:07 user nova-compute[71516]: WARNING nova.compute.manager [req-48c7ef89-ed91-4308-85c2-f6092361fae0 req-38b2a93a-f046-48a0-91ef-c3e282974c70 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received unexpected event network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance with vm_state building and task_state spawning.
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:19:07 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:19:07 user nova-compute[71516]: INFO nova.compute.manager [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Took 6.09 seconds to spawn the instance on the hypervisor.
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.173s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:19:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:08 user nova-compute[71516]: INFO nova.compute.manager [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Took 6.87 seconds to build instance.
Apr 11 23:19:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.003s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Cannot resize image /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG nova.objects.instance [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'migration_context' on Instance uuid e8b26dd1-48ce-476d-99e8-60001f2d7528 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Ensure instance console log exists: /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG nova.network.neutron [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Successfully created port: d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG nova.network.neutron [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Successfully updated port: d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquired lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG nova.network.neutron [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Received event network-changed-d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Refreshing instance network info cache due to event network-changed-d998a3e0-2a86-43bd-8193-a63c4013c7c7. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:19:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] Acquiring lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.network.neutron [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.network.neutron [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Updating instance_info_cache with network_info: [{"id": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "address": "fa:16:3e:e0:a2:de", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd998a3e0-2a", "ovs_interfaceid": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Releasing lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Instance network_info: |[{"id": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "address": "fa:16:3e:e0:a2:de", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd998a3e0-2a", "ovs_interfaceid": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] Acquired lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.network.neutron [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Refreshing network info cache for port d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Start _get_guest_xml network_info=[{"id": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "address": "fa:16:3e:e0:a2:de", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd998a3e0-2a", "ovs_interfaceid": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:19:09 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:19:09 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-3910123',display_name='tempest-ServerActionsTestJSON-server-3910123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-3910123',id=33,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-osljbtf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=e8b26dd1-48ce-476d-99e8-60001f2d7528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "address": "fa:16:3e:e0:a2:de", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd998a3e0-2a", "ovs_interfaceid": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "address": "fa:16:3e:e0:a2:de", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd998a3e0-2a", "ovs_interfaceid": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a2:de,bridge_name='br-int',has_traffic_filtering=True,id=d998a3e0-2a86-43bd-8193-a63c4013c7c7,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd998a3e0-2a') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.objects.instance [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'pci_devices' on Instance uuid e8b26dd1-48ce-476d-99e8-60001f2d7528 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:19:09 user nova-compute[71516]:   <uuid>e8b26dd1-48ce-476d-99e8-60001f2d7528</uuid>
Apr 11 23:19:09 user nova-compute[71516]:   <name>instance-00000021</name>
Apr 11 23:19:09 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:19:09 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:19:09 user nova-compute[71516]:   <metadata>
Apr 11 23:19:09 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:19:09 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:19:09 user nova-compute[71516]:       <nova:name>tempest-ServerActionsTestJSON-server-3910123</nova:name>
Apr 11 23:19:09 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:19:09</nova:creationTime>
Apr 11 23:19:09 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:19:09 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:19:09 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:19:09 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:19:09 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:19:09 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:19:09 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:19:09 user nova-compute[71516]:       <nova:owner>
Apr 11 23:19:09 user nova-compute[71516]:         <nova:user uuid="ddc7eb14e7174babb8680b4020243c97">tempest-ServerActionsTestJSON-813592275-project-member</nova:user>
Apr 11 23:19:09 user nova-compute[71516]:         <nova:project uuid="2fca37343b414de6b008ad79e022f858">tempest-ServerActionsTestJSON-813592275</nova:project>
Apr 11 23:19:09 user nova-compute[71516]:       </nova:owner>
Apr 11 23:19:09 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:19:09 user nova-compute[71516]:       <nova:ports>
Apr 11 23:19:09 user nova-compute[71516]:         <nova:port uuid="d998a3e0-2a86-43bd-8193-a63c4013c7c7">
Apr 11 23:19:09 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 23:19:09 user nova-compute[71516]:         </nova:port>
Apr 11 23:19:09 user nova-compute[71516]:       </nova:ports>
Apr 11 23:19:09 user nova-compute[71516]:     </nova:instance>
Apr 11 23:19:09 user nova-compute[71516]:   </metadata>
Apr 11 23:19:09 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:19:09 user nova-compute[71516]:     <system>
Apr 11 23:19:09 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:19:09 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:19:09 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:19:09 user nova-compute[71516]:       <entry name="serial">e8b26dd1-48ce-476d-99e8-60001f2d7528</entry>
Apr 11 23:19:09 user nova-compute[71516]:       <entry name="uuid">e8b26dd1-48ce-476d-99e8-60001f2d7528</entry>
Apr 11 23:19:09 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:19:09 user nova-compute[71516]:     </system>
Apr 11 23:19:09 user nova-compute[71516]:   </sysinfo>
Apr 11 23:19:09 user nova-compute[71516]:   <os>
Apr 11 23:19:09 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:19:09 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:19:09 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:19:09 user nova-compute[71516]:   </os>
Apr 11 23:19:09 user nova-compute[71516]:   <features>
Apr 11 23:19:09 user nova-compute[71516]:     <acpi/>
Apr 11 23:19:09 user nova-compute[71516]:     <apic/>
Apr 11 23:19:09 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:19:09 user nova-compute[71516]:   </features>
Apr 11 23:19:09 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:19:09 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:19:09 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:19:09 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:19:09 user nova-compute[71516]:   </clock>
Apr 11 23:19:09 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:19:09 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:19:09 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:19:09 user nova-compute[71516]:   </cpu>
Apr 11 23:19:09 user nova-compute[71516]:   <devices>
Apr 11 23:19:09 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:19:09 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:19:09 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk"/>
Apr 11 23:19:09 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:19:09 user nova-compute[71516]:     </disk>
Apr 11 23:19:09 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:19:09 user nova-compute[71516]:       <mac address="fa:16:3e:e0:a2:de"/>
Apr 11 23:19:09 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:19:09 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:19:09 user nova-compute[71516]:       <target dev="tapd998a3e0-2a"/>
Apr 11 23:19:09 user nova-compute[71516]:     </interface>
Apr 11 23:19:09 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:19:09 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/console.log" append="off"/>
Apr 11 23:19:09 user nova-compute[71516]:     </serial>
Apr 11 23:19:09 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:19:09 user nova-compute[71516]:     <video>
Apr 11 23:19:09 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:19:09 user nova-compute[71516]:     </video>
Apr 11 23:19:09 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:19:09 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:19:09 user nova-compute[71516]:     </rng>
Apr 11 23:19:09 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:19:09 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:19:09 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:19:09 user nova-compute[71516]:     </memballoon>
Apr 11 23:19:09 user nova-compute[71516]:   </devices>
Apr 11 23:19:09 user nova-compute[71516]: </domain>
Apr 11 23:19:09 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-3910123',display_name='tempest-ServerActionsTestJSON-server-3910123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-3910123',id=33,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-osljbtf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=e8b26dd1-48ce-476d-99e8-60001f2d7528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "address": "fa:16:3e:e0:a2:de", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd998a3e0-2a", "ovs_interfaceid": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "address": "fa:16:3e:e0:a2:de", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd998a3e0-2a", "ovs_interfaceid": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a2:de,bridge_name='br-int',has_traffic_filtering=True,id=d998a3e0-2a86-43bd-8193-a63c4013c7c7,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd998a3e0-2a') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG os_vif [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a2:de,bridge_name='br-int',has_traffic_filtering=True,id=d998a3e0-2a86-43bd-8193-a63c4013c7c7,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd998a3e0-2a') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd998a3e0-2a, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd998a3e0-2a, col_values=(('external_ids', {'iface-id': 'd998a3e0-2a86-43bd-8193-a63c4013c7c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:a2:de', 'vm-uuid': 'e8b26dd1-48ce-476d-99e8-60001f2d7528'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:09 user nova-compute[71516]: INFO os_vif [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a2:de,bridge_name='br-int',has_traffic_filtering=True,id=d998a3e0-2a86-43bd-8193-a63c4013c7c7,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd998a3e0-2a')
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:19:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No VIF found with MAC fa:16:3e:e0:a2:de, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG nova.network.neutron [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Updated VIF entry in instance network info cache for port d998a3e0-2a86-43bd-8193-a63c4013c7c7. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG nova.network.neutron [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Updating instance_info_cache with network_info: [{"id": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "address": "fa:16:3e:e0:a2:de", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd998a3e0-2a", "ovs_interfaceid": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] Releasing lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:19:10 user nova-compute[71516]: INFO nova.compute.claims [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Claim successful on node user
Apr 11 23:19:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:19:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG nova.network.neutron [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:19:11 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:19:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG nova.policy [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:19:11 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Creating image(s)
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "/opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "/opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "/opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-46857b9e-dd77-4799-8646-2af3d7f7010b req-24c76675-32d1-4a9b-b66a-e0889666b949 service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Received event network-vif-plugged-d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-46857b9e-dd77-4799-8646-2af3d7f7010b req-24c76675-32d1-4a9b-b66a-e0889666b949 service nova] Acquiring lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-46857b9e-dd77-4799-8646-2af3d7f7010b req-24c76675-32d1-4a9b-b66a-e0889666b949 service nova] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-46857b9e-dd77-4799-8646-2af3d7f7010b req-24c76675-32d1-4a9b-b66a-e0889666b949 service nova] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-46857b9e-dd77-4799-8646-2af3d7f7010b req-24c76675-32d1-4a9b-b66a-e0889666b949 service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] No waiting events found dispatching network-vif-plugged-d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:19:11 user nova-compute[71516]: WARNING nova.compute.manager [req-46857b9e-dd77-4799-8646-2af3d7f7010b req-24c76675-32d1-4a9b-b66a-e0889666b949 service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Received unexpected event network-vif-plugged-d998a3e0-2a86-43bd-8193-a63c4013c7c7 for instance with vm_state building and task_state spawning.
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.195s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.191s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk 1073741824" returned: 0 in 0.058s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:12 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:19:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:12 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Cannot resize image /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:19:12 user nova-compute[71516]: DEBUG nova.objects.instance [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'migration_context' on Instance uuid 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:19:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:19:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Ensure instance console log exists: /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:19:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:12 user nova-compute[71516]: DEBUG nova.network.neutron [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Successfully created port: 484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Successfully updated port: 484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "refresh_cache-5014e85f-b341-4d4d-83f9-6641ee426a46" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquired lock "refresh_cache-5014e85f-b341-4d4d-83f9-6641ee426a46" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255153.4883146, e8b26dd1-48ce-476d-99e8-60001f2d7528 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:19:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] VM Resumed (Lifecycle Event)
Apr 11 23:19:13 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Instance spawned successfully.
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Received event network-vif-plugged-d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] Acquiring lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] No waiting events found dispatching network-vif-plugged-d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:19:13 user nova-compute[71516]: WARNING nova.compute.manager [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Received unexpected event network-vif-plugged-d998a3e0-2a86-43bd-8193-a63c4013c7c7 for instance with vm_state building and task_state spawning.
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Received event network-changed-484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Refreshing instance network info cache due to event network-changed-484a65b3-2e3e-4c0c-8035-c002575411ba. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] Acquiring lock "refresh_cache-5014e85f-b341-4d4d-83f9-6641ee426a46" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Updating instance_info_cache with network_info: [{"id": "484a65b3-2e3e-4c0c-8035-c002575411ba", "address": "fa:16:3e:94:77:2a", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484a65b3-2e", "ovs_interfaceid": "484a65b3-2e3e-4c0c-8035-c002575411ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:19:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255153.4884868, e8b26dd1-48ce-476d-99e8-60001f2d7528 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:19:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] VM Started (Lifecycle Event)
Apr 11 23:19:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Releasing lock "refresh_cache-5014e85f-b341-4d4d-83f9-6641ee426a46" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Instance network_info: |[{"id": "484a65b3-2e3e-4c0c-8035-c002575411ba", "address": "fa:16:3e:94:77:2a", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484a65b3-2e", "ovs_interfaceid": "484a65b3-2e3e-4c0c-8035-c002575411ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] Acquired lock "refresh_cache-5014e85f-b341-4d4d-83f9-6641ee426a46" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.network.neutron [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Refreshing network info cache for port 484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Start _get_guest_xml network_info=[{"id": "484a65b3-2e3e-4c0c-8035-c002575411ba", "address": "fa:16:3e:94:77:2a", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484a65b3-2e", "ovs_interfaceid": "484a65b3-2e3e-4c0c-8035-c002575411ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:13 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:19:13 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1752444058',display_name='tempest-AttachVolumeTestJSON-server-1752444058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1752444058',id=34,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd6J9Hfhfl3k6suA3VXx505Hz3ymCZc6NkXJqG6wdldGsvO/ASBV5wMoZFTIiO5UnutLW+qfE9dn9LQpAB0adzm2fiHkMxgQ9UOrhoV8PdfuFDGyKYzVyo6Y9veMg9JWg==',key_name='tempest-keypair-1733576032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0ff3d48596a44f8ac8d9306becd8178',ramdisk_id='',reservation_id='r-yrdt40r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-343820803',owner_user_name='tempest-AttachVolumeTestJSON-343820803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:19:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1793cec543e8425899474614b2c10f5d',uuid=5014e85f-b341-4d4d-83f9-6641ee426a46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "484a65b3-2e3e-4c0c-8035-c002575411ba", "address": "fa:16:3e:94:77:2a", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484a65b3-2e", "ovs_interfaceid": "484a65b3-2e3e-4c0c-8035-c002575411ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converting VIF {"id": "484a65b3-2e3e-4c0c-8035-c002575411ba", "address": "fa:16:3e:94:77:2a", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484a65b3-2e", "ovs_interfaceid": "484a65b3-2e3e-4c0c-8035-c002575411ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:77:2a,bridge_name='br-int',has_traffic_filtering=True,id=484a65b3-2e3e-4c0c-8035-c002575411ba,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484a65b3-2e') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.objects.instance [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'pci_devices' on Instance uuid 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:19:13 user nova-compute[71516]: INFO nova.compute.manager [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Took 6.29 seconds to spawn the instance on the hypervisor.
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:19:13 user nova-compute[71516]:   <uuid>5014e85f-b341-4d4d-83f9-6641ee426a46</uuid>
Apr 11 23:19:13 user nova-compute[71516]:   <name>instance-00000022</name>
Apr 11 23:19:13 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:19:13 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:19:13 user nova-compute[71516]:   <metadata>
Apr 11 23:19:13 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:19:13 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:19:13 user nova-compute[71516]:       <nova:name>tempest-AttachVolumeTestJSON-server-1752444058</nova:name>
Apr 11 23:19:13 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:19:13</nova:creationTime>
Apr 11 23:19:13 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:19:13 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:19:13 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:19:13 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:19:13 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:19:13 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:19:13 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:19:13 user nova-compute[71516]:       <nova:owner>
Apr 11 23:19:13 user nova-compute[71516]:         <nova:user uuid="1793cec543e8425899474614b2c10f5d">tempest-AttachVolumeTestJSON-343820803-project-member</nova:user>
Apr 11 23:19:13 user nova-compute[71516]:         <nova:project uuid="f0ff3d48596a44f8ac8d9306becd8178">tempest-AttachVolumeTestJSON-343820803</nova:project>
Apr 11 23:19:13 user nova-compute[71516]:       </nova:owner>
Apr 11 23:19:13 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:19:13 user nova-compute[71516]:       <nova:ports>
Apr 11 23:19:13 user nova-compute[71516]:         <nova:port uuid="484a65b3-2e3e-4c0c-8035-c002575411ba">
Apr 11 23:19:13 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 23:19:13 user nova-compute[71516]:         </nova:port>
Apr 11 23:19:13 user nova-compute[71516]:       </nova:ports>
Apr 11 23:19:13 user nova-compute[71516]:     </nova:instance>
Apr 11 23:19:13 user nova-compute[71516]:   </metadata>
Apr 11 23:19:13 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:19:13 user nova-compute[71516]:     <system>
Apr 11 23:19:13 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:19:13 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:19:13 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:19:13 user nova-compute[71516]:       <entry name="serial">5014e85f-b341-4d4d-83f9-6641ee426a46</entry>
Apr 11 23:19:13 user nova-compute[71516]:       <entry name="uuid">5014e85f-b341-4d4d-83f9-6641ee426a46</entry>
Apr 11 23:19:13 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:19:13 user nova-compute[71516]:     </system>
Apr 11 23:19:13 user nova-compute[71516]:   </sysinfo>
Apr 11 23:19:13 user nova-compute[71516]:   <os>
Apr 11 23:19:13 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:19:13 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:19:13 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:19:13 user nova-compute[71516]:   </os>
Apr 11 23:19:13 user nova-compute[71516]:   <features>
Apr 11 23:19:13 user nova-compute[71516]:     <acpi/>
Apr 11 23:19:13 user nova-compute[71516]:     <apic/>
Apr 11 23:19:13 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:19:13 user nova-compute[71516]:   </features>
Apr 11 23:19:13 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:19:13 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:19:13 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:19:13 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:19:13 user nova-compute[71516]:   </clock>
Apr 11 23:19:13 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:19:13 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:19:13 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:19:13 user nova-compute[71516]:   </cpu>
Apr 11 23:19:13 user nova-compute[71516]:   <devices>
Apr 11 23:19:13 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:19:13 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:19:13 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk"/>
Apr 11 23:19:13 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:19:13 user nova-compute[71516]:     </disk>
Apr 11 23:19:13 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:19:13 user nova-compute[71516]:       <mac address="fa:16:3e:94:77:2a"/>
Apr 11 23:19:13 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:19:13 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:19:13 user nova-compute[71516]:       <target dev="tap484a65b3-2e"/>
Apr 11 23:19:13 user nova-compute[71516]:     </interface>
Apr 11 23:19:13 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:19:13 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/console.log" append="off"/>
Apr 11 23:19:13 user nova-compute[71516]:     </serial>
Apr 11 23:19:13 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:19:13 user nova-compute[71516]:     <video>
Apr 11 23:19:13 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:19:13 user nova-compute[71516]:     </video>
Apr 11 23:19:13 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:19:13 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:19:13 user nova-compute[71516]:     </rng>
Apr 11 23:19:13 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:19:13 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:19:13 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:19:13 user nova-compute[71516]:     </memballoon>
Apr 11 23:19:13 user nova-compute[71516]:   </devices>
Apr 11 23:19:13 user nova-compute[71516]: </domain>
Apr 11 23:19:13 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1752444058',display_name='tempest-AttachVolumeTestJSON-server-1752444058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1752444058',id=34,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd6J9Hfhfl3k6suA3VXx505Hz3ymCZc6NkXJqG6wdldGsvO/ASBV5wMoZFTIiO5UnutLW+qfE9dn9LQpAB0adzm2fiHkMxgQ9UOrhoV8PdfuFDGyKYzVyo6Y9veMg9JWg==',key_name='tempest-keypair-1733576032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0ff3d48596a44f8ac8d9306becd8178',ramdisk_id='',reservation_id='r-yrdt40r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-343820803',owner_user_name='tempest-AttachVolumeTestJSON-343820803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:19:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1793cec543e8425899474614b2c10f5d',uuid=5014e85f-b341-4d4d-83f9-6641ee426a46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "484a65b3-2e3e-4c0c-8035-c002575411ba", "address": "fa:16:3e:94:77:2a", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484a65b3-2e", "ovs_interfaceid": "484a65b3-2e3e-4c0c-8035-c002575411ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converting VIF {"id": "484a65b3-2e3e-4c0c-8035-c002575411ba", "address": "fa:16:3e:94:77:2a", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484a65b3-2e", "ovs_interfaceid": "484a65b3-2e3e-4c0c-8035-c002575411ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:77:2a,bridge_name='br-int',has_traffic_filtering=True,id=484a65b3-2e3e-4c0c-8035-c002575411ba,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484a65b3-2e') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG os_vif [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:77:2a,bridge_name='br-int',has_traffic_filtering=True,id=484a65b3-2e3e-4c0c-8035-c002575411ba,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484a65b3-2e') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap484a65b3-2e, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap484a65b3-2e, col_values=(('external_ids', {'iface-id': '484a65b3-2e3e-4c0c-8035-c002575411ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:77:2a', 'vm-uuid': '5014e85f-b341-4d4d-83f9-6641ee426a46'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:19:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:19:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:13 user nova-compute[71516]: INFO os_vif [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:77:2a,bridge_name='br-int',has_traffic_filtering=True,id=484a65b3-2e3e-4c0c-8035-c002575411ba,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484a65b3-2e')
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:19:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No VIF found with MAC fa:16:3e:94:77:2a, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:19:13 user nova-compute[71516]: INFO nova.compute.manager [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Took 7.09 seconds to build instance.
Apr 11 23:19:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.196s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:14 user nova-compute[71516]: DEBUG nova.network.neutron [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Updated VIF entry in instance network info cache for port 484a65b3-2e3e-4c0c-8035-c002575411ba. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:19:14 user nova-compute[71516]: DEBUG nova.network.neutron [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Updating instance_info_cache with network_info: [{"id": "484a65b3-2e3e-4c0c-8035-c002575411ba", "address": "fa:16:3e:94:77:2a", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484a65b3-2e", "ovs_interfaceid": "484a65b3-2e3e-4c0c-8035-c002575411ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:19:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] Releasing lock "refresh_cache-5014e85f-b341-4d4d-83f9-6641ee426a46" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:19:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-1b36f020-0c9e-4599-8c21-cfbfc77e1202 req-fe50fb15-5411-4c4e-a641-7716f191f0db service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Received event network-vif-plugged-484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1b36f020-0c9e-4599-8c21-cfbfc77e1202 req-fe50fb15-5411-4c4e-a641-7716f191f0db service nova] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1b36f020-0c9e-4599-8c21-cfbfc77e1202 req-fe50fb15-5411-4c4e-a641-7716f191f0db service nova] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1b36f020-0c9e-4599-8c21-cfbfc77e1202 req-fe50fb15-5411-4c4e-a641-7716f191f0db service nova] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-1b36f020-0c9e-4599-8c21-cfbfc77e1202 req-fe50fb15-5411-4c4e-a641-7716f191f0db service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] No waiting events found dispatching network-vif-plugged-484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:19:15 user nova-compute[71516]: WARNING nova.compute.manager [req-1b36f020-0c9e-4599-8c21-cfbfc77e1202 req-fe50fb15-5411-4c4e-a641-7716f191f0db service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Received unexpected event network-vif-plugged-484a65b3-2e3e-4c0c-8035-c002575411ba for instance with vm_state building and task_state spawning.
Apr 11 23:19:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-8eb3faea-437c-4f69-b442-22e1d900f06a req-9587083a-143d-4fb8-bd23-6b29304f0262 service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Received event network-vif-plugged-484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8eb3faea-437c-4f69-b442-22e1d900f06a req-9587083a-143d-4fb8-bd23-6b29304f0262 service nova] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8eb3faea-437c-4f69-b442-22e1d900f06a req-9587083a-143d-4fb8-bd23-6b29304f0262 service nova] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-8eb3faea-437c-4f69-b442-22e1d900f06a req-9587083a-143d-4fb8-bd23-6b29304f0262 service nova] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-8eb3faea-437c-4f69-b442-22e1d900f06a req-9587083a-143d-4fb8-bd23-6b29304f0262 service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] No waiting events found dispatching network-vif-plugged-484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:19:17 user nova-compute[71516]: WARNING nova.compute.manager [req-8eb3faea-437c-4f69-b442-22e1d900f06a req-9587083a-143d-4fb8-bd23-6b29304f0262 service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Received unexpected event network-vif-plugged-484a65b3-2e3e-4c0c-8035-c002575411ba for instance with vm_state building and task_state spawning.
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255157.866476, 5014e85f-b341-4d4d-83f9-6641ee426a46 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:19:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] VM Resumed (Lifecycle Event)
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:19:17 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Instance spawned successfully.
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:19:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255157.8666313, 5014e85f-b341-4d4d-83f9-6641ee426a46 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:19:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] VM Started (Lifecycle Event)
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:19:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:19:18 user nova-compute[71516]: INFO nova.compute.manager [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Took 6.68 seconds to spawn the instance on the hypervisor.
Apr 11 23:19:18 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:18 user nova-compute[71516]: INFO nova.compute.manager [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Took 7.73 seconds to build instance.
Apr 11 23:19:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.849s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:31 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:19:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:19:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:19:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:19:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:19:33 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:19:33 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Updating instance_info_cache with network_info: [{"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:19:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:19:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:19:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:19:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:36 user nova-compute[71516]: INFO nova.compute.manager [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Unrescuing
Apr 11 23:19:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquired lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG nova.network.neutron [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:37 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:19:37 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=7802MB free_disk=26.187660217285156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 90fabe62-030d-46f9-ba2f-0f484e987022 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.network.neutron [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Updating instance_info_cache with network_info: [{"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Releasing lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.objects.instance [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'flavor' on Instance uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-68e8023b-a24a-4122-b6d9-d3a8d692a234 req-9555686a-4d4e-4d75-894e-ebeebcebdcd5 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-unplugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-68e8023b-a24a-4122-b6d9-d3a8d692a234 req-9555686a-4d4e-4d75-894e-ebeebcebdcd5 service nova] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-68e8023b-a24a-4122-b6d9-d3a8d692a234 req-9555686a-4d4e-4d75-894e-ebeebcebdcd5 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-68e8023b-a24a-4122-b6d9-d3a8d692a234 req-9555686a-4d4e-4d75-894e-ebeebcebdcd5 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-68e8023b-a24a-4122-b6d9-d3a8d692a234 req-9555686a-4d4e-4d75-894e-ebeebcebdcd5 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] No waiting events found dispatching network-vif-unplugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:19:37 user nova-compute[71516]: WARNING nova.compute.manager [req-68e8023b-a24a-4122-b6d9-d3a8d692a234 req-9555686a-4d4e-4d75-894e-ebeebcebdcd5 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received unexpected event network-vif-unplugged-af81e577-93ac-47a7-8666-377d53fad5c2 for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:19:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:38 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Instance destroyed successfully.
Apr 11 23:19:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] No waiting events found dispatching network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:19:39 user nova-compute[71516]: WARNING nova.compute.manager [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received unexpected event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:19:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] No waiting events found dispatching network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:19:39 user nova-compute[71516]: WARNING nova.compute.manager [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received unexpected event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:19:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for dd8aa618-99bb-49d7-b547-e5db4470f4c6 due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255181.6095946, dd8aa618-99bb-49d7-b547-e5db4470f4c6 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:19:41 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] VM Resumed (Lifecycle Event)
Apr 11 23:19:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:19:41 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 23:19:41 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255181.613039, dd8aa618-99bb-49d7-b547-e5db4470f4c6 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:19:41 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] VM Started (Lifecycle Event)
Apr 11 23:19:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-af7b85e9-9854-49d7-85a5-918193fb5782 req-33b99d3d-981b-4e24-94ef-135ec9bb8cd4 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af7b85e9-9854-49d7-85a5-918193fb5782 req-33b99d3d-981b-4e24-94ef-135ec9bb8cd4 service nova] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af7b85e9-9854-49d7-85a5-918193fb5782 req-33b99d3d-981b-4e24-94ef-135ec9bb8cd4 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af7b85e9-9854-49d7-85a5-918193fb5782 req-33b99d3d-981b-4e24-94ef-135ec9bb8cd4 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-af7b85e9-9854-49d7-85a5-918193fb5782 req-33b99d3d-981b-4e24-94ef-135ec9bb8cd4 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] No waiting events found dispatching network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:19:41 user nova-compute[71516]: WARNING nova.compute.manager [req-af7b85e9-9854-49d7-85a5-918193fb5782 req-33b99d3d-981b-4e24-94ef-135ec9bb8cd4 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received unexpected event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 for instance with vm_state active and task_state None.
Apr 11 23:19:42 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:19:43 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:19:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:53 user nova-compute[71516]: INFO nova.compute.manager [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Unshelving
Apr 11 23:19:53 user nova-compute[71516]: INFO nova.virt.block_device [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Booting with volume 1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 at /dev/vda
Apr 11 23:19:53 user nova-compute[71516]: DEBUG os_brick.utils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc95b686-2153-4b0d-9b47-45d08ca63583]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3614d9ce-5cce-445d-ad09-909cb78d7e8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd5dce5-5c2d-4a60-be7d-75f079ed8f2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fdfc10-cb90-4179-8a65-9b5ecd96c5ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:19:53 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:19:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55c7555-6375-45ec-9297-33b10650d466]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG os_brick.utils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updating existing volume attachment record: 7fe02fc7-df37-4fb4-b4c7-b8ba0a4d534f {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:19:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:57 user nova-compute[71516]: DEBUG nova.objects.instance [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lazy-loading 'pci_requests' on Instance uuid 8d9f6a0d-caab-4f42-a9b1-a4653b90559f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:19:57 user nova-compute[71516]: DEBUG nova.objects.instance [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d9f6a0d-caab-4f42-a9b1-a4653b90559f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:19:57 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:19:57 user nova-compute[71516]: INFO nova.compute.claims [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Claim successful on node user
Apr 11 23:19:58 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:19:58 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:19:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:58 user nova-compute[71516]: INFO nova.network.neutron [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updating port 5bd8ff97-1370-4a98-8111-ac1c6635a9ee with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 23:19:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquired lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.network.neutron [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-changed-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.compute.manager [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Refreshing instance network info cache due to event network-changed-5bd8ff97-1370-4a98-8111-ac1c6635a9ee. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] Acquiring lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.network.neutron [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updating instance_info_cache with network_info: [{"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Releasing lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:19:59 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Creating image(s)
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Ensure instance console log exists: /opt/stack/data/nova/instances/8d9f6a0d-caab-4f42-a9b1-a4653b90559f/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Start _get_guest_xml network_info=[{"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePzEAZJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d9f6a0d-caab-4f42-a9b1-a4653b90559f', 'attached_at': '', 'detached_at': '', 'volume_id': '1ba1bebe-9c96-4eb9-813a-593d2a5a4d94', 'serial': '1ba1bebe-9c96-4eb9-813a-593d2a5a4d94'}, 'disk_bus': 'virtio', 'attachment_id': '7fe02fc7-df37-4fb4-b4c7-b8ba0a4d534f', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] Acquired lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.network.neutron [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Refreshing network info cache for port 5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:19:59 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:19:59 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.objects.instance [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d9f6a0d-caab-4f42-a9b1-a4653b90559f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePzEAZJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:19:59 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:19:59 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:19:59 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06952f1-b7b2-47a9-9be1-6e8bf9868d03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:19:59 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[627363e0-905f-413f-a8ba-18a64769a9a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94] added
Apr 11 23:19:59 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d967b9-ba8a-4ae3-a56c-d74c9573f63e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1401853c-db8d-4584-912a-1620416e37f8]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePzEAZJp {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePzEAZJp" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c737f86-619b-46d9-ae1d-1ac98b85ffa7]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ePzEAZJp'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[68874839-559a-4534-93fa-c5e78d24e943]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[99703b43-548f-43a0-8410-fee881859d25]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:19:59 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:19:59 user nova-compute[71516]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:19:59 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:19:59 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:19:59 user nova-compute[71516]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:19:59 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4017a140-84f3-4a93-a5af-66e75047ce19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260]
Apr 11 23:19:59 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260] successful.
Apr 11 23:19:59 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c55395-f073-4993-b898-a65e03234309]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6311f895-a91b-4cd6-9e4b-090a789a7ebd]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:19:59 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:19:59 user nova-compute[71516]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:19:59 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:19:59 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:19:59 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:19:59 user nova-compute[71516]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:19:59 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:19:59 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d057af10-9f1d-4fd1-b1aa-3bdedc160e5d]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:19:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePzEAZJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:20:00 user nova-compute[71516]: DEBUG nova.network.neutron [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updated VIF entry in instance network info cache for port 5bd8ff97-1370-4a98-8111-ac1c6635a9ee. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:20:00 user nova-compute[71516]: DEBUG nova.network.neutron [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updating instance_info_cache with network_info: [{"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:20:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] Releasing lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:20:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:20:00 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26238336437363632', 'path': '/dev/sde'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:20:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238336437363632', 'path': '/dev/sde'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:20:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1643016946',display_name='tempest-TestShelveInstance-server-1643016946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1643016946',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1561116455',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:16:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3252362661dd4f8c9ad6298048a84c6a',ramdisk_id='',reservation_id='r-k4wk8wut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-932398179',owner_user_name='tempest-TestShelveInstance-932398179-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:19:53Z,user_data=None,user_id='acfb7fc33f4e4694bcc224292ac5f231',uuid=8d9f6a0d-caab-4f42-a9b1-a4653b90559f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:20:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Converting VIF {"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:20:00 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:20:00 user nova-compute[71516]: DEBUG nova.objects.instance [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d9f6a0d-caab-4f42-a9b1-a4653b90559f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:20:01 user nova-compute[71516]:   <uuid>8d9f6a0d-caab-4f42-a9b1-a4653b90559f</uuid>
Apr 11 23:20:01 user nova-compute[71516]:   <name>instance-0000001c</name>
Apr 11 23:20:01 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:20:01 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:20:01 user nova-compute[71516]:   <metadata>
Apr 11 23:20:01 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:20:01 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:20:01 user nova-compute[71516]:       <nova:name>tempest-TestShelveInstance-server-1643016946</nova:name>
Apr 11 23:20:01 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:19:59</nova:creationTime>
Apr 11 23:20:01 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:20:01 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:20:01 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:20:01 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:20:01 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:20:01 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:20:01 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:20:01 user nova-compute[71516]:       <nova:owner>
Apr 11 23:20:01 user nova-compute[71516]:         <nova:user uuid="acfb7fc33f4e4694bcc224292ac5f231">tempest-TestShelveInstance-932398179-project-member</nova:user>
Apr 11 23:20:01 user nova-compute[71516]:         <nova:project uuid="3252362661dd4f8c9ad6298048a84c6a">tempest-TestShelveInstance-932398179</nova:project>
Apr 11 23:20:01 user nova-compute[71516]:       </nova:owner>
Apr 11 23:20:01 user nova-compute[71516]:       <nova:ports>
Apr 11 23:20:01 user nova-compute[71516]:         <nova:port uuid="5bd8ff97-1370-4a98-8111-ac1c6635a9ee">
Apr 11 23:20:01 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 23:20:01 user nova-compute[71516]:         </nova:port>
Apr 11 23:20:01 user nova-compute[71516]:       </nova:ports>
Apr 11 23:20:01 user nova-compute[71516]:     </nova:instance>
Apr 11 23:20:01 user nova-compute[71516]:   </metadata>
Apr 11 23:20:01 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:20:01 user nova-compute[71516]:     <system>
Apr 11 23:20:01 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:20:01 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:20:01 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:20:01 user nova-compute[71516]:       <entry name="serial">8d9f6a0d-caab-4f42-a9b1-a4653b90559f</entry>
Apr 11 23:20:01 user nova-compute[71516]:       <entry name="uuid">8d9f6a0d-caab-4f42-a9b1-a4653b90559f</entry>
Apr 11 23:20:01 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:20:01 user nova-compute[71516]:     </system>
Apr 11 23:20:01 user nova-compute[71516]:   </sysinfo>
Apr 11 23:20:01 user nova-compute[71516]:   <os>
Apr 11 23:20:01 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:20:01 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:20:01 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:20:01 user nova-compute[71516]:   </os>
Apr 11 23:20:01 user nova-compute[71516]:   <features>
Apr 11 23:20:01 user nova-compute[71516]:     <acpi/>
Apr 11 23:20:01 user nova-compute[71516]:     <apic/>
Apr 11 23:20:01 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:20:01 user nova-compute[71516]:   </features>
Apr 11 23:20:01 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:20:01 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:20:01 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:20:01 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:20:01 user nova-compute[71516]:   </clock>
Apr 11 23:20:01 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:20:01 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:20:01 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:20:01 user nova-compute[71516]:   </cpu>
Apr 11 23:20:01 user nova-compute[71516]:   <devices>
Apr 11 23:20:01 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:20:01 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:20:01 user nova-compute[71516]:       <source dev="/dev/sde"/>
Apr 11 23:20:01 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:20:01 user nova-compute[71516]:       <serial>1ba1bebe-9c96-4eb9-813a-593d2a5a4d94</serial>
Apr 11 23:20:01 user nova-compute[71516]:     </disk>
Apr 11 23:20:01 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:20:01 user nova-compute[71516]:       <mac address="fa:16:3e:59:76:73"/>
Apr 11 23:20:01 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:20:01 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:20:01 user nova-compute[71516]:       <target dev="tap5bd8ff97-13"/>
Apr 11 23:20:01 user nova-compute[71516]:     </interface>
Apr 11 23:20:01 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:20:01 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/8d9f6a0d-caab-4f42-a9b1-a4653b90559f/console.log" append="off"/>
Apr 11 23:20:01 user nova-compute[71516]:     </serial>
Apr 11 23:20:01 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:20:01 user nova-compute[71516]:     <video>
Apr 11 23:20:01 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:20:01 user nova-compute[71516]:     </video>
Apr 11 23:20:01 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:20:01 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:20:01 user nova-compute[71516]:     </rng>
Apr 11 23:20:01 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:20:01 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:20:01 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:20:01 user nova-compute[71516]:     </memballoon>
Apr 11 23:20:01 user nova-compute[71516]:   </devices>
Apr 11 23:20:01 user nova-compute[71516]: </domain>
Apr 11 23:20:01 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1643016946',display_name='tempest-TestShelveInstance-server-1643016946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1643016946',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1561116455',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:16:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3252362661dd4f8c9ad6298048a84c6a',ramdisk_id='',reservation_id='r-k4wk8wut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-932398179',owner_user_name='tempest-TestShelveInstance-932398179-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:19:53Z,user_data=None,user_id='acfb7fc33f4e4694bcc224292ac5f231',uuid=8d9f6a0d-caab-4f42-a9b1-a4653b90559f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Converting VIF {"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG os_vif [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bd8ff97-13, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5bd8ff97-13, col_values=(('external_ids', {'iface-id': '5bd8ff97-1370-4a98-8111-ac1c6635a9ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:76:73', 'vm-uuid': '8d9f6a0d-caab-4f42-a9b1-a4653b90559f'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:01 user nova-compute[71516]: INFO os_vif [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13')
Apr 11 23:20:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:20:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] No VIF found with MAC fa:16:3e:59:76:73, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:20:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:02 user nova-compute[71516]: DEBUG nova.compute.manager [req-13418d98-10a7-43f1-a9cb-8dde699dd819 req-18ea5c83-368e-44b5-b95c-53c80bf40a30 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-13418d98-10a7-43f1-a9cb-8dde699dd819 req-18ea5c83-368e-44b5-b95c-53c80bf40a30 service nova] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-13418d98-10a7-43f1-a9cb-8dde699dd819 req-18ea5c83-368e-44b5-b95c-53c80bf40a30 service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-13418d98-10a7-43f1-a9cb-8dde699dd819 req-18ea5c83-368e-44b5-b95c-53c80bf40a30 service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:02 user nova-compute[71516]: DEBUG nova.compute.manager [req-13418d98-10a7-43f1-a9cb-8dde699dd819 req-18ea5c83-368e-44b5-b95c-53c80bf40a30 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] No waiting events found dispatching network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:20:02 user nova-compute[71516]: WARNING nova.compute.manager [req-13418d98-10a7-43f1-a9cb-8dde699dd819 req-18ea5c83-368e-44b5-b95c-53c80bf40a30 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received unexpected event network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 23:20:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:04 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255204.5526698, 8d9f6a0d-caab-4f42-a9b1-a4653b90559f => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:20:04 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] VM Resumed (Lifecycle Event)
Apr 11 23:20:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:20:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:20:04 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Instance spawned successfully.
Apr 11 23:20:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:20:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:20:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:20:04 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:20:04 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255204.5551589, 8d9f6a0d-caab-4f42-a9b1-a4653b90559f => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:20:04 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] VM Started (Lifecycle Event)
Apr 11 23:20:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:20:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:20:04 user nova-compute[71516]: DEBUG nova.compute.manager [req-ea910d9a-cede-41c5-a633-bb939e1329a1 req-0c189f1f-99fe-455d-a529-069ff2559ffc service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ea910d9a-cede-41c5-a633-bb939e1329a1 req-0c189f1f-99fe-455d-a529-069ff2559ffc service nova] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ea910d9a-cede-41c5-a633-bb939e1329a1 req-0c189f1f-99fe-455d-a529-069ff2559ffc service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ea910d9a-cede-41c5-a633-bb939e1329a1 req-0c189f1f-99fe-455d-a529-069ff2559ffc service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:04 user nova-compute[71516]: DEBUG nova.compute.manager [req-ea910d9a-cede-41c5-a633-bb939e1329a1 req-0c189f1f-99fe-455d-a529-069ff2559ffc service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] No waiting events found dispatching network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:20:04 user nova-compute[71516]: WARNING nova.compute.manager [req-ea910d9a-cede-41c5-a633-bb939e1329a1 req-0c189f1f-99fe-455d-a529-069ff2559ffc service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received unexpected event network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance with vm_state active and task_state None.
Apr 11 23:20:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.342s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "b007f35d-b7e1-401f-8b11-37eda193e79b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:20:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:07 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:20:07 user nova-compute[71516]: INFO nova.compute.claims [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Claim successful on node user
Apr 11 23:20:07 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:20:07 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:20:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:20:08 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:20:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG nova.policy [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '472822fb18a1486993fdfd21429a6823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39bb15903c1c49fba14bf5e1c4a1556b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:20:08 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Creating image(s)
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "/opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "/opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "/opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.145s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk 1073741824" returned: 0 in 0.049s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Cannot resize image /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lazy-loading 'migration_context' on Instance uuid b007f35d-b7e1-401f-8b11-37eda193e79b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Ensure instance console log exists: /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:08 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Successfully created port: 7a39b637-85b5-46da-b7f4-1754f2f38325 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:20:09 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Successfully updated port: 7a39b637-85b5-46da-b7f4-1754f2f38325 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:20:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "refresh_cache-b007f35d-b7e1-401f-8b11-37eda193e79b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:20:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquired lock "refresh_cache-b007f35d-b7e1-401f-8b11-37eda193e79b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:20:09 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:20:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Received event network-changed-7a39b637-85b5-46da-b7f4-1754f2f38325 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Refreshing instance network info cache due to event network-changed-7a39b637-85b5-46da-b7f4-1754f2f38325. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:20:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] Acquiring lock "refresh_cache-b007f35d-b7e1-401f-8b11-37eda193e79b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:20:09 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:20:09 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Updating instance_info_cache with network_info: [{"id": "7a39b637-85b5-46da-b7f4-1754f2f38325", "address": "fa:16:3e:5b:4b:17", "network": {"id": "69caf2c0-0a84-49e1-84cb-6be694771eff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-626254533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "39bb15903c1c49fba14bf5e1c4a1556b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a39b637-85", "ovs_interfaceid": "7a39b637-85b5-46da-b7f4-1754f2f38325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:20:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Releasing lock "refresh_cache-b007f35d-b7e1-401f-8b11-37eda193e79b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:20:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Instance network_info: |[{"id": "7a39b637-85b5-46da-b7f4-1754f2f38325", "address": "fa:16:3e:5b:4b:17", "network": {"id": "69caf2c0-0a84-49e1-84cb-6be694771eff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-626254533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "39bb15903c1c49fba14bf5e1c4a1556b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a39b637-85", "ovs_interfaceid": "7a39b637-85b5-46da-b7f4-1754f2f38325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:20:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] Acquired lock "refresh_cache-b007f35d-b7e1-401f-8b11-37eda193e79b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:20:09 user nova-compute[71516]: DEBUG nova.network.neutron [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Refreshing network info cache for port 7a39b637-85b5-46da-b7f4-1754f2f38325 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Start _get_guest_xml network_info=[{"id": "7a39b637-85b5-46da-b7f4-1754f2f38325", "address": "fa:16:3e:5b:4b:17", "network": {"id": "69caf2c0-0a84-49e1-84cb-6be694771eff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-626254533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "39bb15903c1c49fba14bf5e1c4a1556b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a39b637-85", "ovs_interfaceid": "7a39b637-85b5-46da-b7f4-1754f2f38325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:20:10 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:20:10 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1726484212',display_name='tempest-VolumesActionsTest-instance-1726484212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1726484212',id=35,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39bb15903c1c49fba14bf5e1c4a1556b',ramdisk_id='',reservation_id='r-y3tv5nkz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1880276817',owner_user_name='tempest-VolumesActionsTest-1880276817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:20:08Z,user_data=None,user_id='472822fb18a1486993fdfd21429a6823',uuid=b007f35d-b7e1-401f-8b11-37eda193e79b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a39b637-85b5-46da-b7f4-1754f2f38325", "address": "fa:16:3e:5b:4b:17", "network": {"id": "69caf2c0-0a84-49e1-84cb-6be694771eff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-626254533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "39bb15903c1c49fba14bf5e1c4a1556b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a39b637-85", "ovs_interfaceid": "7a39b637-85b5-46da-b7f4-1754f2f38325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Converting VIF {"id": "7a39b637-85b5-46da-b7f4-1754f2f38325", "address": "fa:16:3e:5b:4b:17", "network": {"id": "69caf2c0-0a84-49e1-84cb-6be694771eff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-626254533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "39bb15903c1c49fba14bf5e1c4a1556b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a39b637-85", "ovs_interfaceid": "7a39b637-85b5-46da-b7f4-1754f2f38325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4b:17,bridge_name='br-int',has_traffic_filtering=True,id=7a39b637-85b5-46da-b7f4-1754f2f38325,network=Network(69caf2c0-0a84-49e1-84cb-6be694771eff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a39b637-85') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lazy-loading 'pci_devices' on Instance uuid b007f35d-b7e1-401f-8b11-37eda193e79b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:20:10 user nova-compute[71516]:   <uuid>b007f35d-b7e1-401f-8b11-37eda193e79b</uuid>
Apr 11 23:20:10 user nova-compute[71516]:   <name>instance-00000023</name>
Apr 11 23:20:10 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:20:10 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:20:10 user nova-compute[71516]:   <metadata>
Apr 11 23:20:10 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:20:10 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:20:10 user nova-compute[71516]:       <nova:name>tempest-VolumesActionsTest-instance-1726484212</nova:name>
Apr 11 23:20:10 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:20:10</nova:creationTime>
Apr 11 23:20:10 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:20:10 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:20:10 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:20:10 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:20:10 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:20:10 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:20:10 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:20:10 user nova-compute[71516]:       <nova:owner>
Apr 11 23:20:10 user nova-compute[71516]:         <nova:user uuid="472822fb18a1486993fdfd21429a6823">tempest-VolumesActionsTest-1880276817-project-member</nova:user>
Apr 11 23:20:10 user nova-compute[71516]:         <nova:project uuid="39bb15903c1c49fba14bf5e1c4a1556b">tempest-VolumesActionsTest-1880276817</nova:project>
Apr 11 23:20:10 user nova-compute[71516]:       </nova:owner>
Apr 11 23:20:10 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:20:10 user nova-compute[71516]:       <nova:ports>
Apr 11 23:20:10 user nova-compute[71516]:         <nova:port uuid="7a39b637-85b5-46da-b7f4-1754f2f38325">
Apr 11 23:20:10 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 23:20:10 user nova-compute[71516]:         </nova:port>
Apr 11 23:20:10 user nova-compute[71516]:       </nova:ports>
Apr 11 23:20:10 user nova-compute[71516]:     </nova:instance>
Apr 11 23:20:10 user nova-compute[71516]:   </metadata>
Apr 11 23:20:10 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:20:10 user nova-compute[71516]:     <system>
Apr 11 23:20:10 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:20:10 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:20:10 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:20:10 user nova-compute[71516]:       <entry name="serial">b007f35d-b7e1-401f-8b11-37eda193e79b</entry>
Apr 11 23:20:10 user nova-compute[71516]:       <entry name="uuid">b007f35d-b7e1-401f-8b11-37eda193e79b</entry>
Apr 11 23:20:10 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:20:10 user nova-compute[71516]:     </system>
Apr 11 23:20:10 user nova-compute[71516]:   </sysinfo>
Apr 11 23:20:10 user nova-compute[71516]:   <os>
Apr 11 23:20:10 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:20:10 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:20:10 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:20:10 user nova-compute[71516]:   </os>
Apr 11 23:20:10 user nova-compute[71516]:   <features>
Apr 11 23:20:10 user nova-compute[71516]:     <acpi/>
Apr 11 23:20:10 user nova-compute[71516]:     <apic/>
Apr 11 23:20:10 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:20:10 user nova-compute[71516]:   </features>
Apr 11 23:20:10 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:20:10 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:20:10 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:20:10 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:20:10 user nova-compute[71516]:   </clock>
Apr 11 23:20:10 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:20:10 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:20:10 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:20:10 user nova-compute[71516]:   </cpu>
Apr 11 23:20:10 user nova-compute[71516]:   <devices>
Apr 11 23:20:10 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:20:10 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:20:10 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk"/>
Apr 11 23:20:10 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:20:10 user nova-compute[71516]:     </disk>
Apr 11 23:20:10 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:20:10 user nova-compute[71516]:       <mac address="fa:16:3e:5b:4b:17"/>
Apr 11 23:20:10 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:20:10 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:20:10 user nova-compute[71516]:       <target dev="tap7a39b637-85"/>
Apr 11 23:20:10 user nova-compute[71516]:     </interface>
Apr 11 23:20:10 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:20:10 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/console.log" append="off"/>
Apr 11 23:20:10 user nova-compute[71516]:     </serial>
Apr 11 23:20:10 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:20:10 user nova-compute[71516]:     <video>
Apr 11 23:20:10 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:20:10 user nova-compute[71516]:     </video>
Apr 11 23:20:10 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:20:10 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:20:10 user nova-compute[71516]:     </rng>
Apr 11 23:20:10 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:20:10 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:20:10 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:20:10 user nova-compute[71516]:     </memballoon>
Apr 11 23:20:10 user nova-compute[71516]:   </devices>
Apr 11 23:20:10 user nova-compute[71516]: </domain>
Apr 11 23:20:10 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1726484212',display_name='tempest-VolumesActionsTest-instance-1726484212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1726484212',id=35,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39bb15903c1c49fba14bf5e1c4a1556b',ramdisk_id='',reservation_id='r-y3tv5nkz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1880276817',owner_user_name='tempest-VolumesActionsTest-1880276817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:20:08Z,user_data=None,user_id='472822fb18a1486993fdfd21429a6823',uuid=b007f35d-b7e1-401f-8b11-37eda193e79b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a39b637-85b5-46da-b7f4-1754f2f38325", "address": "fa:16:3e:5b:4b:17", "network": {"id": "69caf2c0-0a84-49e1-84cb-6be694771eff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-626254533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "39bb15903c1c49fba14bf5e1c4a1556b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a39b637-85", "ovs_interfaceid": "7a39b637-85b5-46da-b7f4-1754f2f38325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Converting VIF {"id": "7a39b637-85b5-46da-b7f4-1754f2f38325", "address": "fa:16:3e:5b:4b:17", "network": {"id": "69caf2c0-0a84-49e1-84cb-6be694771eff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-626254533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "39bb15903c1c49fba14bf5e1c4a1556b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a39b637-85", "ovs_interfaceid": "7a39b637-85b5-46da-b7f4-1754f2f38325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4b:17,bridge_name='br-int',has_traffic_filtering=True,id=7a39b637-85b5-46da-b7f4-1754f2f38325,network=Network(69caf2c0-0a84-49e1-84cb-6be694771eff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a39b637-85') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG os_vif [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4b:17,bridge_name='br-int',has_traffic_filtering=True,id=7a39b637-85b5-46da-b7f4-1754f2f38325,network=Network(69caf2c0-0a84-49e1-84cb-6be694771eff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a39b637-85') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a39b637-85, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a39b637-85, col_values=(('external_ids', {'iface-id': '7a39b637-85b5-46da-b7f4-1754f2f38325', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:4b:17', 'vm-uuid': 'b007f35d-b7e1-401f-8b11-37eda193e79b'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:10 user nova-compute[71516]: INFO os_vif [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4b:17,bridge_name='br-int',has_traffic_filtering=True,id=7a39b637-85b5-46da-b7f4-1754f2f38325,network=Network(69caf2c0-0a84-49e1-84cb-6be694771eff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a39b637-85')
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] No VIF found with MAC fa:16:3e:5b:4b:17, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.network.neutron [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Updated VIF entry in instance network info cache for port 7a39b637-85b5-46da-b7f4-1754f2f38325. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG nova.network.neutron [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Updating instance_info_cache with network_info: [{"id": "7a39b637-85b5-46da-b7f4-1754f2f38325", "address": "fa:16:3e:5b:4b:17", "network": {"id": "69caf2c0-0a84-49e1-84cb-6be694771eff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-626254533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "39bb15903c1c49fba14bf5e1c4a1556b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a39b637-85", "ovs_interfaceid": "7a39b637-85b5-46da-b7f4-1754f2f38325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:20:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] Releasing lock "refresh_cache-b007f35d-b7e1-401f-8b11-37eda193e79b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:20:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-2f99446b-80f5-464d-8526-87b5523a6742 req-03a469d9-bdaa-4d09-a8ef-f73933ba1aa9 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Received event network-vif-plugged-7a39b637-85b5-46da-b7f4-1754f2f38325 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2f99446b-80f5-464d-8526-87b5523a6742 req-03a469d9-bdaa-4d09-a8ef-f73933ba1aa9 service nova] Acquiring lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2f99446b-80f5-464d-8526-87b5523a6742 req-03a469d9-bdaa-4d09-a8ef-f73933ba1aa9 service nova] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2f99446b-80f5-464d-8526-87b5523a6742 req-03a469d9-bdaa-4d09-a8ef-f73933ba1aa9 service nova] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-2f99446b-80f5-464d-8526-87b5523a6742 req-03a469d9-bdaa-4d09-a8ef-f73933ba1aa9 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] No waiting events found dispatching network-vif-plugged-7a39b637-85b5-46da-b7f4-1754f2f38325 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:20:11 user nova-compute[71516]: WARNING nova.compute.manager [req-2f99446b-80f5-464d-8526-87b5523a6742 req-03a469d9-bdaa-4d09-a8ef-f73933ba1aa9 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Received unexpected event network-vif-plugged-7a39b637-85b5-46da-b7f4-1754f2f38325 for instance with vm_state building and task_state spawning.
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255213.5556512, b007f35d-b7e1-401f-8b11-37eda193e79b => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:20:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] VM Resumed (Lifecycle Event)
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:20:13 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Instance spawned successfully.
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:20:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255213.5595272, b007f35d-b7e1-401f-8b11-37eda193e79b => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:20:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] VM Started (Lifecycle Event)
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:20:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:20:13 user nova-compute[71516]: INFO nova.compute.manager [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Took 5.47 seconds to spawn the instance on the hypervisor.
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-b6ef5577-d0f2-49f7-bf14-be32fafc7a3e req-5b69825e-c2b4-43c2-ae5e-8cb3c77cf913 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Received event network-vif-plugged-7a39b637-85b5-46da-b7f4-1754f2f38325 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b6ef5577-d0f2-49f7-bf14-be32fafc7a3e req-5b69825e-c2b4-43c2-ae5e-8cb3c77cf913 service nova] Acquiring lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b6ef5577-d0f2-49f7-bf14-be32fafc7a3e req-5b69825e-c2b4-43c2-ae5e-8cb3c77cf913 service nova] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b6ef5577-d0f2-49f7-bf14-be32fafc7a3e req-5b69825e-c2b4-43c2-ae5e-8cb3c77cf913 service nova] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-b6ef5577-d0f2-49f7-bf14-be32fafc7a3e req-5b69825e-c2b4-43c2-ae5e-8cb3c77cf913 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] No waiting events found dispatching network-vif-plugged-7a39b637-85b5-46da-b7f4-1754f2f38325 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:20:13 user nova-compute[71516]: WARNING nova.compute.manager [req-b6ef5577-d0f2-49f7-bf14-be32fafc7a3e req-5b69825e-c2b4-43c2-ae5e-8cb3c77cf913 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Received unexpected event network-vif-plugged-7a39b637-85b5-46da-b7f4-1754f2f38325 for instance with vm_state building and task_state spawning.
Apr 11 23:20:13 user nova-compute[71516]: INFO nova.compute.manager [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Took 6.23 seconds to build instance.
Apr 11 23:20:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.466s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Received event network-changed-5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Refreshing instance network info cache due to event network-changed-5602a828-929f-4fd6-bd61-f4d5717f6ca4. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:20:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] Acquiring lock "refresh_cache-90fabe62-030d-46f9-ba2f-0f484e987022" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:20:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] Acquired lock "refresh_cache-90fabe62-030d-46f9-ba2f-0f484e987022" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:20:20 user nova-compute[71516]: DEBUG nova.network.neutron [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Refreshing network info cache for port 5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:20:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG nova.network.neutron [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Updated VIF entry in instance network info cache for port 5602a828-929f-4fd6-bd61-f4d5717f6ca4. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG nova.network.neutron [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Updating instance_info_cache with network_info: [{"id": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "address": "fa:16:3e:df:d3:22", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5602a828-92", "ovs_interfaceid": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] Releasing lock "refresh_cache-90fabe62-030d-46f9-ba2f-0f484e987022" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Received event network-changed-5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Refreshing instance network info cache due to event network-changed-5602a828-929f-4fd6-bd61-f4d5717f6ca4. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] Acquiring lock "refresh_cache-90fabe62-030d-46f9-ba2f-0f484e987022" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] Acquired lock "refresh_cache-90fabe62-030d-46f9-ba2f-0f484e987022" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG nova.network.neutron [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Refreshing network info cache for port 5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "90fabe62-030d-46f9-ba2f-0f484e987022" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "90fabe62-030d-46f9-ba2f-0f484e987022" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:21 user nova-compute[71516]: INFO nova.compute.manager [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Terminating instance
Apr 11 23:20:21 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG nova.network.neutron [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Updated VIF entry in instance network info cache for port 5602a828-929f-4fd6-bd61-f4d5717f6ca4. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG nova.network.neutron [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Updating instance_info_cache with network_info: [{"id": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "address": "fa:16:3e:df:d3:22", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5602a828-92", "ovs_interfaceid": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] Releasing lock "refresh_cache-90fabe62-030d-46f9-ba2f-0f484e987022" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:20:22 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Instance destroyed successfully.
Apr 11 23:20:22 user nova-compute[71516]: DEBUG nova.objects.instance [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lazy-loading 'resources' on Instance uuid 90fabe62-030d-46f9-ba2f-0f484e987022 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1048278755',display_name='tempest-TestVolumeBootPattern-server-1048278755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1048278755',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTeA7e6j/wrChwM1jogClH0JWZ33jOggStHh7lL1aQsrNXULlUHFl3iqjE9etghhRnMsyLyd4JqIILvNvoCcqVmiQ5foShdj8Q9wa2sI4sRIJCvJ4hRZ+cCGZXsMJkWw==',key_name='tempest-TestVolumeBootPattern-15540354',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:18:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-rsa2f0lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:18:39Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=90fabe62-030d-46f9-ba2f-0f484e987022,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "address": "fa:16:3e:df:d3:22", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5602a828-92", "ovs_interfaceid": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "address": "fa:16:3e:df:d3:22", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5602a828-92", "ovs_interfaceid": "5602a828-929f-4fd6-bd61-f4d5717f6ca4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:d3:22,bridge_name='br-int',has_traffic_filtering=True,id=5602a828-929f-4fd6-bd61-f4d5717f6ca4,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5602a828-92') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_vif [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:d3:22,bridge_name='br-int',has_traffic_filtering=True,id=5602a828-929f-4fd6-bd61-f4d5717f6ca4,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5602a828-92') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5602a828-92, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:20:22 user nova-compute[71516]: INFO os_vif [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:d3:22,bridge_name='br-int',has_traffic_filtering=True,id=5602a828-929f-4fd6-bd61-f4d5717f6ca4,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5602a828-92')
Apr 11 23:20:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWpvPATi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:20:22 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f578cbe-664e-49a4-9f86-07c762dcedb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:20:22 user nova-compute[71516]: No targets found.
Apr 11 23:20:22 user nova-compute[71516]: iSNS:
Apr 11 23:20:22 user nova-compute[71516]: No targets found.
Apr 11 23:20:22 user nova-compute[71516]: STATIC:
Apr 11 23:20:22 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e
Apr 11 23:20:22 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:20:22 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:20:22 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4
Apr 11 23:20:22 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:20:22 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:20:22 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94
Apr 11 23:20:22 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:20:22 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:20:22 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd
Apr 11 23:20:22 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:20:22 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:20:22 user nova-compute[71516]: FIRMWARE:
Apr 11 23:20:22 user nova-compute[71516]: No targets found.
Apr 11 23:20:22 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:20:22 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:20:22 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Received event network-vif-unplugged-5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] Acquiring lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] Lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] Lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] No waiting events found dispatching network-vif-unplugged-5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Received event network-vif-unplugged-5602a828-929f-4fd6-bd61-f4d5717f6ca4 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Received event network-vif-plugged-5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] Acquiring lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] Lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] Lock "90fabe62-030d-46f9-ba2f-0f484e987022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] No waiting events found dispatching network-vif-plugged-5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:20:22 user nova-compute[71516]: WARNING nova.compute.manager [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Received unexpected event network-vif-plugged-5602a828-929f-4fd6-bd61-f4d5717f6ca4 for instance with vm_state active and task_state deleting.
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[14558f8c-d727-4456-810f-813f19b8b139]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2b82f2-2b7f-4d06-b862-d737737cf177]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:20:22 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:20:22 user nova-compute[71516]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:20:22 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:20:22 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:20:22 user nova-compute[71516]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 (non-flash)
Apr 11 23:20:22 user nova-compute[71516]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:20:22 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:20:22 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5fef6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4'): ({'sdb'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Removing single pathed devices sdb {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a31d958-294d-454c-8a95-2af97ff4f2b3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8632d1-92fe-441a-814e-90f57c4159d3]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flushing IO for device /dev/sdb {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[257af520-1297-414f-91f1-05c1340f92a6]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c12919-6d6d-413e-b74a-4672d1e149f3]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3a5ec0c4-27ed6339cf94bbf0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3a5ec0c4', '/dev/disk/by-id/scsi-23237656436333339') {{(pid=81691) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1826ba01-9eea-4a3c-956f-961d475d447d]: (4, None) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbd3822-a776-4a3a-b507-4a9054f9d9b1]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:22 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:23 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5693a712-5883-4993-8ed2-010d3fb8470c]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4, portal: 172.16.0.220,3260]
Apr 11 23:20:23 user nova-compute[71516]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4, portal: 172.16.0.220,3260] successful.
Apr 11 23:20:23 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:23 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[087267db-9b62-4ca2-b4c4-e7c2f3e07f9e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:20:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== disconnect_volume: return (408ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:20:23 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:20:23 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Deleting instance files /opt/stack/data/nova/instances/90fabe62-030d-46f9-ba2f-0f484e987022_del
Apr 11 23:20:23 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Deletion of /opt/stack/data/nova/instances/90fabe62-030d-46f9-ba2f-0f484e987022_del complete
Apr 11 23:20:23 user nova-compute[71516]: INFO nova.compute.manager [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Took 1.32 seconds to destroy the instance on the hypervisor.
Apr 11 23:20:23 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:20:23 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:20:23 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:20:23 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:20:23 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Took 0.53 seconds to deallocate network for instance.
Apr 11 23:20:23 user nova-compute[71516]: DEBUG nova.compute.manager [req-e56c52b9-8b67-49b0-8885-1fd6fb760a44 req-2007a7c5-e04f-4c2a-b311-859065fe5620 service nova] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Received event network-vif-deleted-5602a828-929f-4fd6-bd61-f4d5717f6ca4 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:24 user nova-compute[71516]: INFO nova.compute.manager [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Took 0.83 seconds to detach 1 volumes for instance.
Apr 11 23:20:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:24 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:20:24 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:20:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:25 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Deleted allocations for instance 90fabe62-030d-46f9-ba2f-0f484e987022
Apr 11 23:20:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "90fabe62-030d-46f9-ba2f-0f484e987022" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.370s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:29 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:20:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 23:20:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] There are 0 instances to clean {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 23:20:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:20:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updating instance_info_cache with network_info: [{"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:35 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:20:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255222.6255896, 90fabe62-030d-46f9-ba2f-0f484e987022 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:20:37 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] VM Stopped (Lifecycle Event)
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6c6ff747-621d-4d3f-927d-04076fdda03d None None] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:20:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:38 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:20:38 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:20:38 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=7724MB free_disk=26.174644470214844GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:20:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance b007f35d-b7e1-401f-8b11-37eda193e79b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances with incomplete migration  {{(pid=71516) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 23:20:39 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:20:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:20:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:20:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:20:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:20:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:20:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:20:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:43 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:20:43 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:20:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-changed-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Refreshing instance network info cache due to event network-changed-86961f23-bd39-44da-8ad9-4420b80e9223. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:20:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] Acquiring lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:20:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] Acquired lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:20:44 user nova-compute[71516]: DEBUG nova.network.neutron [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Refreshing network info cache for port 86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:20:45 user nova-compute[71516]: DEBUG nova.network.neutron [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updated VIF entry in instance network info cache for port 86961f23-bd39-44da-8ad9-4420b80e9223. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:20:45 user nova-compute[71516]: DEBUG nova.network.neutron [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updating instance_info_cache with network_info: [{"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:20:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] Releasing lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:20:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:46 user nova-compute[71516]: INFO nova.compute.manager [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Detaching volume 5c7fe861-90c1-4630-a64a-73b40239df5e
Apr 11 23:20:46 user nova-compute[71516]: INFO nova.virt.block_device [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Attempting to driver detach volume 5c7fe861-90c1-4630-a64a-73b40239df5e from mountpoint /dev/vdb
Apr 11 23:20:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Attempting to detach device vdb from instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:20:46 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:20:46 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:20:46 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:20:46 user nova-compute[71516]:   <serial>5c7fe861-90c1-4630-a64a-73b40239df5e</serial>
Apr 11 23:20:46 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 23:20:46 user nova-compute[71516]: </disk>
Apr 11 23:20:46 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:20:46 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Successfully detached device vdb from instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c from the persistent domain config.
Apr 11 23:20:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:20:46 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:20:46 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:20:46 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:20:46 user nova-compute[71516]:   <serial>5c7fe861-90c1-4630-a64a-73b40239df5e</serial>
Apr 11 23:20:46 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 23:20:46 user nova-compute[71516]: </disk>
Apr 11 23:20:46 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-changed-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Refreshing instance network info cache due to event network-changed-86961f23-bd39-44da-8ad9-4420b80e9223. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] Acquiring lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] Acquired lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG nova.network.neutron [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Refreshing network info cache for port 86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681255246.7136, 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:20:46 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Successfully detached device vdb from instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c from the live domain config.
Apr 11 23:20:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHRPXdFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:20:46 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf40ad8-ffe0-4f5e-8414-bb05a014da51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:20:46 user nova-compute[71516]: No targets found.
Apr 11 23:20:46 user nova-compute[71516]: iSNS:
Apr 11 23:20:46 user nova-compute[71516]: No targets found.
Apr 11 23:20:46 user nova-compute[71516]: STATIC:
Apr 11 23:20:46 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e
Apr 11 23:20:46 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:20:46 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:20:46 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94
Apr 11 23:20:46 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:20:46 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:20:46 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd
Apr 11 23:20:46 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:20:46 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:20:46 user nova-compute[71516]: FIRMWARE:
Apr 11 23:20:46 user nova-compute[71516]: No targets found.
Apr 11 23:20:46 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:20:46 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:20:46 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5138a64f-8ad7-4a77-a89e-5b265c7a6cbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f156569d-269f-44d6-8f45-68fb06ea7438]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:20:46 user nova-compute[71516]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:20:46 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:20:46 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:20:46 user nova-compute[71516]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e (non-flash)
Apr 11 23:20:46 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:20:46 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c187400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[957ffa3b-bd73-41cc-b6fd-f2295eb19f30]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b1d000-ccc1-4aef-a447-84edcbf57d2d]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9edc0a-5350-4e1b-bcac-cea9a0b57a6d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9244d8ad-49b1-4711-b124-e69abfd9348b]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4079136-f63f-41d1-8202-f6b1fa8458bf]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90ba69a-e53b-41d7-b09e-2062bdcbf441]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260]
Apr 11 23:20:46 user nova-compute[71516]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e, portal: 172.16.0.220,3260] successful.
Apr 11 23:20:46 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7fe861-90c1-4630-a64a-73b40239df5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:47 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86426d1-4086-4b9d-81a8-4489287e50cc]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:20:47 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] <== disconnect_volume: return (283ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:20:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:20:47 user nova-compute[71516]: DEBUG nova.network.neutron [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updated VIF entry in instance network info cache for port 86961f23-bd39-44da-8ad9-4420b80e9223. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:20:47 user nova-compute[71516]: DEBUG nova.network.neutron [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updating instance_info_cache with network_info: [{"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:20:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] Releasing lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:20:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:47 user nova-compute[71516]: DEBUG nova.objects.instance [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'flavor' on Instance uuid 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:20:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.816s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received event network-changed-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Refreshing instance network info cache due to event network-changed-79f30c94-ec16-4a33-b97e-639ce9a383c8. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:20:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] Acquiring lock "refresh_cache-bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:20:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] Acquired lock "refresh_cache-bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:20:52 user nova-compute[71516]: DEBUG nova.network.neutron [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Refreshing network info cache for port 79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:20:52 user nova-compute[71516]: DEBUG nova.network.neutron [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Updated VIF entry in instance network info cache for port 79f30c94-ec16-4a33-b97e-639ce9a383c8. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:20:52 user nova-compute[71516]: DEBUG nova.network.neutron [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Updating instance_info_cache with network_info: [{"id": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "address": "fa:16:3e:17:84:71", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f30c94-ec", "ovs_interfaceid": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:20:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] Releasing lock "refresh_cache-bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:20:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'flavor' on Instance uuid bd78e8ee-ec6a-4de8-8146-bd37787b5c2c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:20:53 user nova-compute[71516]: INFO nova.compute.manager [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Attaching volume d4bbf528-5c40-4276-acce-e97fe84f22d3 to /dev/vdb
Apr 11 23:20:53 user nova-compute[71516]: DEBUG os_brick.utils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff52b8da-060c-445b-ab9c-29967d4eddbb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b2433e-f4e6-4a14-be22-223e05e58148]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c474436-f769-48c4-a4d6-dcc152abcc05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5385063-69f7-44c3-9dda-13ce49c8ac6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:20:53 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:20:53 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce67d8c1-0860-49fc-84da-5b1f587ac9b9]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG os_brick.utils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:20:53 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Updating existing volume attachment record: e9449b9f-8d67-45a4-b76e-3b20eb28ca7b {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:20:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Received event network-changed-d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:20:57 user nova-compute[71516]: DEBUG nova.compute.manager [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Refreshing instance network info cache due to event network-changed-d998a3e0-2a86-43bd-8193-a63c4013c7c7. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:20:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] Acquiring lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:20:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] Acquired lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:20:57 user nova-compute[71516]: DEBUG nova.network.neutron [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Refreshing network info cache for port d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:20:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG nova.network.neutron [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Updated VIF entry in instance network info cache for port d998a3e0-2a86-43bd-8193-a63c4013c7c7. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG nova.network.neutron [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Updating instance_info_cache with network_info: [{"id": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "address": "fa:16:3e:e0:a2:de", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd998a3e0-2a", "ovs_interfaceid": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] Releasing lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQhCkmlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:20:58 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:20:58 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:20:58 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6596cdf3-9cde-492f-92d1-35fdcf034450]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:20:58 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded30f89-93f0-451b-bbc0-16903b3e9831]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3] added
Apr 11 23:20:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.043s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[399523ac-ba28-41af-8e38-d9f8f6f7b837]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1975640a-a269-4f29-a9a5-eedd4a4ddd3c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQhCkmlB {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQhCkmlB" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bee2df-378d-46b2-bbc8-6c53a6b2899c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LQhCkmlB'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[354509a7-521f-4d51-95ee-cc2df7bcc59b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e562ba-c631-4edc-83b5-b39d30126742]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:20:58 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:20:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:20:58 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:20:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[691a97db-8a15-4e4a-9592-46c63d22b561]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3, portal: 172.16.0.220,3260]
Apr 11 23:20:58 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3, portal: 172.16.0.220,3260] successful.
Apr 11 23:20:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79156a4-ed0e-44bf-a5e3-332f7c59dc27]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd720ce-81fe-4b4f-87c8-d280e9fd442f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:20:58 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:20:58 user nova-compute[71516]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 (non-flash)
Apr 11 23:20:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:20:58 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:20:58 user nova-compute[71516]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 (non-flash)
Apr 11 23:20:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90df07d-7088-4903-9b18-594c1e5d24aa]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:20:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQhCkmlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:20:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:20:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26633313437306332', 'path': '/dev/sdb'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:20:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633313437306332', 'path': '/dev/sdb'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:20:59 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'flavor' on Instance uuid bd78e8ee-ec6a-4de8-8146-bd37787b5c2c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:20:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:20:59 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:20:59 user nova-compute[71516]:   <source dev="/dev/sdb"/>
Apr 11 23:20:59 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:20:59 user nova-compute[71516]:   <serial>d4bbf528-5c40-4276-acce-e97fe84f22d3</serial>
Apr 11 23:20:59 user nova-compute[71516]: </disk>
Apr 11 23:20:59 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:20:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:20:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:20:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] No VIF found with MAC fa:16:3e:17:84:71, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:21:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.312s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:00 user nova-compute[71516]: INFO nova.compute.manager [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Detaching volume d4bbf528-5c40-4276-acce-e97fe84f22d3
Apr 11 23:21:00 user nova-compute[71516]: INFO nova.virt.block_device [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Attempting to driver detach volume d4bbf528-5c40-4276-acce-e97fe84f22d3 from mountpoint /dev/vdb
Apr 11 23:21:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Attempting to detach device vdb from instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:21:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:21:00 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:21:00 user nova-compute[71516]:   <source dev="/dev/sdb"/>
Apr 11 23:21:00 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:21:00 user nova-compute[71516]:   <serial>d4bbf528-5c40-4276-acce-e97fe84f22d3</serial>
Apr 11 23:21:00 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:21:00 user nova-compute[71516]: </disk>
Apr 11 23:21:00 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:21:00 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully detached device vdb from instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c from the persistent domain config.
Apr 11 23:21:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:21:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:21:00 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:21:00 user nova-compute[71516]:   <source dev="/dev/sdb"/>
Apr 11 23:21:00 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:21:00 user nova-compute[71516]:   <serial>d4bbf528-5c40-4276-acce-e97fe84f22d3</serial>
Apr 11 23:21:00 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:21:00 user nova-compute[71516]: </disk>
Apr 11 23:21:00 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:21:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681255261.2010882, bd78e8ee-ec6a-4de8-8146-bd37787b5c2c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:21:01 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully detached device vdb from instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c from the live domain config.
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQhCkmlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:21:01 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[92353b5c-cde8-4eaa-85a2-58ec2184adf1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:21:01 user nova-compute[71516]: No targets found.
Apr 11 23:21:01 user nova-compute[71516]: iSNS:
Apr 11 23:21:01 user nova-compute[71516]: No targets found.
Apr 11 23:21:01 user nova-compute[71516]: STATIC:
Apr 11 23:21:01 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3
Apr 11 23:21:01 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:01 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:01 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94
Apr 11 23:21:01 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:01 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:01 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd
Apr 11 23:21:01 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:01 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:01 user nova-compute[71516]: FIRMWARE:
Apr 11 23:21:01 user nova-compute[71516]: No targets found.
Apr 11 23:21:01 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:21:01 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:21:01 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5de93ca-9897-4e05-9c69-41ae9404e23b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9705be-9aac-40a6-a502-68cc5623ca9c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:21:01 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:01 user nova-compute[71516]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 (non-flash)
Apr 11 23:21:01 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:21:01 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:01 user nova-compute[71516]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 (non-flash)
Apr 11 23:21:01 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e4c717f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3'): ({'sdb'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Removing single pathed devices sdb {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcdf8a5-909a-44fe-8e23-1644626bd751]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bc6f52-3e84-4ecf-ad36-68c33a3b6ef4]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flushing IO for device /dev/sdb {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3208a279-7973-4568-9ea9-b271b0425c2f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb0758f-9559-407e-bb61-eb5af5da77c4]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[50575eda-8bf3-4aa7-b74f-1ae436aa092e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "de7744d0-487a-49be-9355-fcf1266af37f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b7f488-9fad-4b54-9391-7c4ea13f5b88]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3, portal: 172.16.0.220,3260]
Apr 11 23:21:01 user nova-compute[71516]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3, portal: 172.16.0.220,3260] successful.
Apr 11 23:21:01 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4bbf528-5c40-4276-acce-e97fe84f22d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[252ab052-f37a-4fe1-ad6f-6093dc59c269]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] <== disconnect_volume: return (321ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Received event network-changed-484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Refreshing instance network info cache due to event network-changed-484a65b3-2e3e-4c0c-8035-c002575411ba. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] Acquiring lock "refresh_cache-5014e85f-b341-4d4d-83f9-6641ee426a46" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] Acquired lock "refresh_cache-5014e85f-b341-4d4d-83f9-6641ee426a46" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.network.neutron [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Refreshing network info cache for port 484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:21:01 user nova-compute[71516]: INFO nova.compute.claims [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Claim successful on node user
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Refreshing inventories for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Updating ProviderTree inventory for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Updating inventory in ProviderTree for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Refreshing aggregate associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, aggregates: None {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 23:21:01 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Refreshing trait associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG nova.network.neutron [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Updated VIF entry in instance network info cache for port 484a65b3-2e3e-4c0c-8035-c002575411ba. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG nova.network.neutron [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Updating instance_info_cache with network_info: [{"id": "484a65b3-2e3e-4c0c-8035-c002575411ba", "address": "fa:16:3e:94:77:2a", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484a65b3-2e", "ovs_interfaceid": "484a65b3-2e3e-4c0c-8035-c002575411ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] Releasing lock "refresh_cache-5014e85f-b341-4d4d-83f9-6641ee426a46" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:21:02 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:21:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:21:02 user nova-compute[71516]: INFO nova.virt.block_device [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Booting with volume 33464ef9-378a-4982-8601-296ed0c6bd35 at /dev/vda
Apr 11 23:21:02 user nova-compute[71516]: DEBUG nova.policy [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG nova.objects.instance [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'flavor' on Instance uuid bd78e8ee-ec6a-4de8-8146-bd37787b5c2c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG os_brick.utils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[81060a66-6df5-4eef-be11-4c009bb1f590]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.879s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[66313657-473f-4816-bd83-ed6a1fa8ce5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0579d763-d84b-45b6-b0b8-804224c245df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[347268c4-7d50-4a6c-ab2e-a979d5889f16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:21:02 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:21:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c98f2e-2de6-4937-ac21-9b35c3357ea7]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG os_brick.utils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updating existing volume attachment record: ee92dcbd-ccc0-40ea-9507-db6122634a18 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Successfully created port: 75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG nova.objects.instance [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'flavor' on Instance uuid 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:03 user nova-compute[71516]: INFO nova.compute.manager [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Attaching volume c70b1197-3dde-4cbe-9034-c0e4dbf636ed to /dev/vdb
Apr 11 23:21:03 user nova-compute[71516]: DEBUG os_brick.utils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc4a2fc-808e-4938-8269-cbfd90f59069]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e98898a-f547-4c94-ae84-6ad10b4c52a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2befb2b-ca53-4822-800e-45031098a7ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[19818b59-37fc-4da4-b260-2374acce70ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:21:03 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[37505c2a-69ee-4b83-8a58-8b62091f47e0]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG os_brick.utils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Updating existing volume attachment record: a97eac61-b20d-4bd6-9308-307ace453698 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Successfully updated port: 75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquired lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received event network-changed-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Refreshing instance network info cache due to event network-changed-75723ce6-e923-483c-a830-85c602bb8454. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] Acquiring lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:21:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:21:04 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updating instance_info_cache with network_info: [{"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Releasing lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:21:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Instance network_info: |[{"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:21:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] Acquired lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:21:04 user nova-compute[71516]: DEBUG nova.network.neutron [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Refreshing network info cache for port 75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:21:04 user nova-compute[71516]: DEBUG nova.network.neutron [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updated VIF entry in instance network info cache for port 75723ce6-e923-483c-a830-85c602bb8454. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:21:04 user nova-compute[71516]: DEBUG nova.network.neutron [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updating instance_info_cache with network_info: [{"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] Releasing lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:21:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_power_states {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:21:06 user nova-compute[71516]: WARNING nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid 61204bbb-04fb-4545-ade1-5665c733c5bd {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid 8d9f6a0d-caab-4f42-a9b1-a4653b90559f {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid bd78e8ee-ec6a-4de8-8146-bd37787b5c2c {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid e8b26dd1-48ce-476d-99e8-60001f2d7528 {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid b007f35d-b7e1-401f-8b11-37eda193e79b {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid de7744d0-487a-49be-9355-fcf1266af37f {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "61204bbb-04fb-4545-ade1-5665c733c5bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "e8b26dd1-48ce-476d-99e8-60001f2d7528" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "b007f35d-b7e1-401f-8b11-37eda193e79b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:21:06 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Creating image(s)
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Ensure instance console log exists: /opt/stack/data/nova/instances/de7744d0-487a-49be-9355-fcf1266af37f/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Start _get_guest_xml network_info=[{"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLNugaoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'de7744d0-487a-49be-9355-fcf1266af37f', 'attached_at': '', 'detached_at': '', 'volume_id': '33464ef9-378a-4982-8601-296ed0c6bd35', 'serial': '33464ef9-378a-4982-8601-296ed0c6bd35'}, 'disk_bus': 'virtio', 'attachment_id': 'ee92dcbd-ccc0-40ea-9507-db6122634a18', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:21:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:21:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLNugaoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:21:06 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:21:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:21:06 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:21:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:21:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:21:06 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:21:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a56e99-e149-48ac-a985-ef944ae18bda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:21:07 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[76146094-f150-412a-ba3f-a5326dd656fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35] added
Apr 11 23:21:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[07472b35-212e-4840-8b7e-b185d65989dc]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2aef1b9-e0dd-4f43-9816-5ce647f4d4ee]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLNugaoS {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLNugaoS" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d1cc54-22cb-4281-96ba-0f451b2e7d96]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nLNugaoS'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57329a8-bec5-48df-8f22-ab9f3fd9aafc]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d8e3d7-cb8e-4bc5-b4a1-d80b419448c8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:21:07 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:21:07 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3eea31-49e6-4470-af87-56a950d67548]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260]
Apr 11 23:21:07 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260] successful.
Apr 11 23:21:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb623755-36b2-42ca-8219-51d7a168df70]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2784fe97-c1f4-4f7b-b35c-7a1fb64c3cb8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:21:07 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:07 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:21:07 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:07 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d00d1a-7a7e-496d-82d4-04aa39edaee9]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLNugaoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVwDAKXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:21:07 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:21:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:21:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23931336134313465', 'path': '/dev/sdb'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931336134313465', 'path': '/dev/sdb'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.674s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:21:08 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:21:08 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-865706147',display_name='tempest-ServerActionsTestJSON-server-865706147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-865706147',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-j4wmwff7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=de7744d0-487a-49be-9355-fcf1266af37f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'pci_devices' on Instance uuid de7744d0-487a-49be-9355-fcf1266af37f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[879bd97f-35ae-4a36-8fd5-c78286bce3dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:21:08 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:21:08 user nova-compute[71516]:   <uuid>de7744d0-487a-49be-9355-fcf1266af37f</uuid>
Apr 11 23:21:08 user nova-compute[71516]:   <name>instance-00000024</name>
Apr 11 23:21:08 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:21:08 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:21:08 user nova-compute[71516]:   <metadata>
Apr 11 23:21:08 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:21:08 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:21:08 user nova-compute[71516]:       <nova:name>tempest-ServerActionsTestJSON-server-865706147</nova:name>
Apr 11 23:21:08 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:21:06</nova:creationTime>
Apr 11 23:21:08 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:21:08 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:21:08 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:21:08 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:21:08 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:21:08 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:21:08 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:21:08 user nova-compute[71516]:       <nova:owner>
Apr 11 23:21:08 user nova-compute[71516]:         <nova:user uuid="ddc7eb14e7174babb8680b4020243c97">tempest-ServerActionsTestJSON-813592275-project-member</nova:user>
Apr 11 23:21:08 user nova-compute[71516]:         <nova:project uuid="2fca37343b414de6b008ad79e022f858">tempest-ServerActionsTestJSON-813592275</nova:project>
Apr 11 23:21:08 user nova-compute[71516]:       </nova:owner>
Apr 11 23:21:08 user nova-compute[71516]:       <nova:ports>
Apr 11 23:21:08 user nova-compute[71516]:         <nova:port uuid="75723ce6-e923-483c-a830-85c602bb8454">
Apr 11 23:21:08 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 23:21:08 user nova-compute[71516]:         </nova:port>
Apr 11 23:21:08 user nova-compute[71516]:       </nova:ports>
Apr 11 23:21:08 user nova-compute[71516]:     </nova:instance>
Apr 11 23:21:08 user nova-compute[71516]:   </metadata>
Apr 11 23:21:08 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:21:08 user nova-compute[71516]:     <system>
Apr 11 23:21:08 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:21:08 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:21:08 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:21:08 user nova-compute[71516]:       <entry name="serial">de7744d0-487a-49be-9355-fcf1266af37f</entry>
Apr 11 23:21:08 user nova-compute[71516]:       <entry name="uuid">de7744d0-487a-49be-9355-fcf1266af37f</entry>
Apr 11 23:21:08 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:21:08 user nova-compute[71516]:     </system>
Apr 11 23:21:08 user nova-compute[71516]:   </sysinfo>
Apr 11 23:21:08 user nova-compute[71516]:   <os>
Apr 11 23:21:08 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:21:08 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:21:08 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:21:08 user nova-compute[71516]:   </os>
Apr 11 23:21:08 user nova-compute[71516]:   <features>
Apr 11 23:21:08 user nova-compute[71516]:     <acpi/>
Apr 11 23:21:08 user nova-compute[71516]:     <apic/>
Apr 11 23:21:08 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:21:08 user nova-compute[71516]:   </features>
Apr 11 23:21:08 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:21:08 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:21:08 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:21:08 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:21:08 user nova-compute[71516]:   </clock>
Apr 11 23:21:08 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:21:08 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:21:08 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:21:08 user nova-compute[71516]:   </cpu>
Apr 11 23:21:08 user nova-compute[71516]:   <devices>
Apr 11 23:21:08 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:21:08 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:21:08 user nova-compute[71516]:       <source dev="/dev/sdb"/>
Apr 11 23:21:08 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:21:08 user nova-compute[71516]:       <serial>33464ef9-378a-4982-8601-296ed0c6bd35</serial>
Apr 11 23:21:08 user nova-compute[71516]:     </disk>
Apr 11 23:21:08 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:21:08 user nova-compute[71516]:       <mac address="fa:16:3e:a9:87:d4"/>
Apr 11 23:21:08 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:21:08 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:21:08 user nova-compute[71516]:       <target dev="tap75723ce6-e9"/>
Apr 11 23:21:08 user nova-compute[71516]:     </interface>
Apr 11 23:21:08 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:21:08 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/de7744d0-487a-49be-9355-fcf1266af37f/console.log" append="off"/>
Apr 11 23:21:08 user nova-compute[71516]:     </serial>
Apr 11 23:21:08 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:21:08 user nova-compute[71516]:     <video>
Apr 11 23:21:08 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:21:08 user nova-compute[71516]:     </video>
Apr 11 23:21:08 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:21:08 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:21:08 user nova-compute[71516]:     </rng>
Apr 11 23:21:08 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:21:08 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:21:08 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:21:08 user nova-compute[71516]:     </memballoon>
Apr 11 23:21:08 user nova-compute[71516]:   </devices>
Apr 11 23:21:08 user nova-compute[71516]: </domain>
Apr 11 23:21:08 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-865706147',display_name='tempest-ServerActionsTestJSON-server-865706147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-865706147',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-j4wmwff7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=de7744d0-487a-49be-9355-fcf1266af37f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_vif [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75723ce6-e9, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75723ce6-e9, col_values=(('external_ids', {'iface-id': '75723ce6-e923-483c-a830-85c602bb8454', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:87:d4', 'vm-uuid': 'de7744d0-487a-49be-9355-fcf1266af37f'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e67830-5a02-4dad-aa5f-af1f0f63ea97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed] added
Apr 11 23:21:08 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:08 user nova-compute[71516]: INFO os_vif [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9')
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3348957e-74db-4a9f-8ed3-43e7b3769be7]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No VIF found with MAC fa:16:3e:a9:87:d4, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6a71c8-75c9-415b-ba7f-0dfa6896c2f5]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVwDAKXZ {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVwDAKXZ" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[35237066-ab8e-4d98-bd8e-70ca58db8f38]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zVwDAKXZ'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc35365-5321-444f-ad28-b71c1a7dcab9]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bebb627-8442-470b-bde0-0b80476de891]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:21:08 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:08 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:08 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:21:08 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:08 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:08 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[932ccb55-7d20-439f-afef-e82ee7ad9428]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed, portal: 172.16.0.220,3260]
Apr 11 23:21:08 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed, portal: 172.16.0.220,3260] successful.
Apr 11 23:21:08 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef9f945-2267-4f9e-9e1e-2ae92b7959d0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3e678d-143a-4fb3-a5d6-2fd4e94ad0ba]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:21:08 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:08 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:08 user nova-compute[71516]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)
Apr 11 23:21:08 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:21:08 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:08 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:08 user nova-compute[71516]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)
Apr 11 23:21:08 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec452cf4-6c3a-4a1d-83e0-eec22084a432]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:21:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVwDAKXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] <== connect_volume: return (2021ms) {'type': 'block', 'scsi_wwn': '23439663861363536', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439663861363536', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG nova.objects.instance [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'flavor' on Instance uuid 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:21:09 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:21:09 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:21:09 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:21:09 user nova-compute[71516]:   <serial>c70b1197-3dde-4cbe-9034-c0e4dbf636ed</serial>
Apr 11 23:21:09 user nova-compute[71516]: </disk>
Apr 11 23:21:09 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-bf3dcd89-0583-48a8-a16b-2d1cb0aba7e2 req-c298d496-202e-4ecf-badb-af36784005f9 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received event network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bf3dcd89-0583-48a8-a16b-2d1cb0aba7e2 req-c298d496-202e-4ecf-badb-af36784005f9 service nova] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bf3dcd89-0583-48a8-a16b-2d1cb0aba7e2 req-c298d496-202e-4ecf-badb-af36784005f9 service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bf3dcd89-0583-48a8-a16b-2d1cb0aba7e2 req-c298d496-202e-4ecf-badb-af36784005f9 service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-bf3dcd89-0583-48a8-a16b-2d1cb0aba7e2 req-c298d496-202e-4ecf-badb-af36784005f9 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] No waiting events found dispatching network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:09 user nova-compute[71516]: WARNING nova.compute.manager [req-bf3dcd89-0583-48a8-a16b-2d1cb0aba7e2 req-c298d496-202e-4ecf-badb-af36784005f9 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received unexpected event network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 for instance with vm_state building and task_state spawning.
Apr 11 23:21:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:21:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:21:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No VIF found with MAC fa:16:3e:94:77:2a, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:21:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.158s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.729s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.compute.manager [req-5347465a-8c8a-4dcd-b487-264a87d3e338 req-d723018d-2834-41d6-8393-c4d902500c66 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received event network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5347465a-8c8a-4dcd-b487-264a87d3e338 req-d723018d-2834-41d6-8393-c4d902500c66 service nova] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5347465a-8c8a-4dcd-b487-264a87d3e338 req-d723018d-2834-41d6-8393-c4d902500c66 service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5347465a-8c8a-4dcd-b487-264a87d3e338 req-d723018d-2834-41d6-8393-c4d902500c66 service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.compute.manager [req-5347465a-8c8a-4dcd-b487-264a87d3e338 req-d723018d-2834-41d6-8393-c4d902500c66 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] No waiting events found dispatching network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:12 user nova-compute[71516]: WARNING nova.compute.manager [req-5347465a-8c8a-4dcd-b487-264a87d3e338 req-d723018d-2834-41d6-8393-c4d902500c66 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received unexpected event network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 for instance with vm_state building and task_state spawning.
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255272.186068, de7744d0-487a-49be-9355-fcf1266af37f => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:21:12 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] VM Resumed (Lifecycle Event)
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:21:12 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Instance spawned successfully.
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:21:12 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255272.1898217, de7744d0-487a-49be-9355-fcf1266af37f => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:21:12 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] VM Started (Lifecycle Event)
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:21:12 user nova-compute[71516]: INFO nova.compute.manager [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Took 5.40 seconds to spawn the instance on the hypervisor.
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:21:12 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:21:12 user nova-compute[71516]: INFO nova.compute.manager [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Took 10.87 seconds to build instance.
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "de7744d0-487a-49be-9355-fcf1266af37f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.991s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "de7744d0-487a-49be-9355-fcf1266af37f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.680s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:12 user nova-compute[71516]: INFO nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "de7744d0-487a-49be-9355-fcf1266af37f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'flavor' on Instance uuid 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:12 user nova-compute[71516]: INFO nova.compute.manager [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Attaching volume a25d580e-d90b-4acd-b6f2-3108fd4af2a7 to /dev/vdc
Apr 11 23:21:12 user nova-compute[71516]: DEBUG os_brick.utils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ddb6ff-ef81-4380-acca-d75cf1a32067]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b7bb73-a297-4b41-a949-e558731b2f64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eccb7fb-c807-4d45-9ed9-4a0263480845]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3605f3b-2aa5-4aa1-ab04-94e4d5395ea5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:21:12 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:21:12 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[26aeec35-fb87-4b12-a546-231d987a0969]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG os_brick.utils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:21:12 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Updating existing volume attachment record: 80105dd3-0f5c-4323-b234-b9c966ccde45 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:21:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Received event network-changed-251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Refreshing instance network info cache due to event network-changed-251c2317-e6a3-40d8-849b-bec8357be943. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] Acquiring lock "refresh_cache-f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] Acquired lock "refresh_cache-f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG nova.network.neutron [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Refreshing network info cache for port 251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:15 user nova-compute[71516]: INFO nova.compute.manager [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Terminating instance
Apr 11 23:21:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG nova.network.neutron [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Updated VIF entry in instance network info cache for port 251c2317-e6a3-40d8-849b-bec8357be943. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG nova.network.neutron [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Updating instance_info_cache with network_info: [{"id": "251c2317-e6a3-40d8-849b-bec8357be943", "address": "fa:16:3e:c4:c9:7b", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251c2317-e6", "ovs_interfaceid": "251c2317-e6a3-40d8-849b-bec8357be943", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] Releasing lock "refresh_cache-f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:21:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:16 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Instance destroyed successfully.
Apr 11 23:21:16 user nova-compute[71516]: DEBUG nova.objects.instance [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lazy-loading 'resources' on Instance uuid f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1799938273',display_name='tempest-TestVolumeBootPattern-server-1799938273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1799938273',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTeA7e6j/wrChwM1jogClH0JWZ33jOggStHh7lL1aQsrNXULlUHFl3iqjE9etghhRnMsyLyd4JqIILvNvoCcqVmiQ5foShdj8Q9wa2sI4sRIJCvJ4hRZ+cCGZXsMJkWw==',key_name='tempest-TestVolumeBootPattern-15540354',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:16:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6700d66136e4f9590658e3103cceac8',ramdisk_id='',reservation_id='r-scpdfg5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-365588456',owner_user_name='tempest-TestVolumeBootPattern-365588456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:16:45Z,user_data=None,user_id='589c07cd12e849cfa38423959e76c695',uuid=f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "251c2317-e6a3-40d8-849b-bec8357be943", "address": "fa:16:3e:c4:c9:7b", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251c2317-e6", "ovs_interfaceid": "251c2317-e6a3-40d8-849b-bec8357be943", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converting VIF {"id": "251c2317-e6a3-40d8-849b-bec8357be943", "address": "fa:16:3e:c4:c9:7b", "network": {"id": "7b0b025e-1b9f-4d76-bce2-a472746f676b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1797692456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6700d66136e4f9590658e3103cceac8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251c2317-e6", "ovs_interfaceid": "251c2317-e6a3-40d8-849b-bec8357be943", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:c9:7b,bridge_name='br-int',has_traffic_filtering=True,id=251c2317-e6a3-40d8-849b-bec8357be943,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251c2317-e6') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_vif [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:c9:7b,bridge_name='br-int',has_traffic_filtering=True,id=251c2317-e6a3-40d8-849b-bec8357be943,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251c2317-e6') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap251c2317-e6, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:21:16 user nova-compute[71516]: INFO os_vif [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:c9:7b,bridge_name='br-int',has_traffic_filtering=True,id=251c2317-e6a3-40d8-849b-bec8357be943,network=Network(7b0b025e-1b9f-4d76-bce2-a472746f676b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251c2317-e6')
Apr 11 23:21:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaBHCpOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:21:16 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff766e57-cbd8-4de8-93eb-bf5c39e836c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:21:16 user nova-compute[71516]: No targets found.
Apr 11 23:21:16 user nova-compute[71516]: iSNS:
Apr 11 23:21:16 user nova-compute[71516]: No targets found.
Apr 11 23:21:16 user nova-compute[71516]: STATIC:
Apr 11 23:21:16 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35
Apr 11 23:21:16 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:16 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:16 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed
Apr 11 23:21:16 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:16 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:16 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94
Apr 11 23:21:16 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:16 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:16 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd
Apr 11 23:21:16 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:16 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:16 user nova-compute[71516]: FIRMWARE:
Apr 11 23:21:16 user nova-compute[71516]: No targets found.
Apr 11 23:21:16 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:21:16 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:21:16 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c1cb23-f21e-4049-a5c4-20099d53eee5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f39ee08-a1eb-4101-a7ba-c59b4a1509bd]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:21:16 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:16 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:16 user nova-compute[71516]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)
Apr 11 23:21:16 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd (non-flash)
Apr 11 23:21:16 user nova-compute[71516]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:16 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:16 user nova-compute[71516]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)
Apr 11 23:21:16 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c662cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd'): ({'sdd'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Removing single pathed devices sdd {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[12931fb5-17ec-492c-9b1d-f1860edcfb91]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f15b87-3472-4cb0-9713-49f7fd093e7f]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flushing IO for device /dev/sdd {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[79970e64-824b-4986-9f39-d5d82f3f1878]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb57b66-0802-4029-a774-2c8ae119e795]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO66a65dec-f496bad6838fcaa0', '/dev/disk/by-id/scsi-26634393662616436', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_66a65dec') {{(pid=81691) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5e5064-dc59-4b51-b0ce-f5240e18fa77]: (4, None) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a641a9-d4ac-4e76-94f1-8391a8ea032b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe17ba77-afc0-4f76-b784-dd5f49399c2a]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260]
Apr 11 23:21:16 user nova-compute[71516]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd, portal: 172.16.0.220,3260] successful.
Apr 11 23:21:16 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170821e-16c7-4cae-a138-dbac84aea6cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[384bd324-f3d4-498f-b424-ae3cc9187fd4]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] <== disconnect_volume: return (371ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:21:16 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Deleting instance files /opt/stack/data/nova/instances/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f_del
Apr 11 23:21:16 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Deletion of /opt/stack/data/nova/instances/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f_del complete
Apr 11 23:21:16 user nova-compute[71516]: INFO nova.compute.manager [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 11 23:21:16 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:21:16 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-54f831f7-4f59-4b1f-ab42-75a7f9dc1985 req-51be5126-2d83-419f-9dcd-b6c50bb54c6c service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Received event network-vif-deleted-251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:17 user nova-compute[71516]: INFO nova.compute.manager [req-54f831f7-4f59-4b1f-ab42-75a7f9dc1985 req-51be5126-2d83-419f-9dcd-b6c50bb54c6c service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Neutron deleted interface 251c2317-e6a3-40d8-849b-bec8357be943; detaching it from the instance and deleting it from the info cache
Apr 11 23:21:17 user nova-compute[71516]: DEBUG nova.network.neutron [req-54f831f7-4f59-4b1f-ab42-75a7f9dc1985 req-51be5126-2d83-419f-9dcd-b6c50bb54c6c service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:17 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Took 0.49 seconds to deallocate network for instance.
Apr 11 23:21:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-54f831f7-4f59-4b1f-ab42-75a7f9dc1985 req-51be5126-2d83-419f-9dcd-b6c50bb54c6c service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Detach interface failed, port_id=251c2317-e6a3-40d8-849b-bec8357be943, reason: Instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Received event network-vif-unplugged-251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] Acquiring lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] No waiting events found dispatching network-vif-unplugged-251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Received event network-vif-unplugged-251c2317-e6a3-40d8-849b-bec8357be943 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Received event network-vif-plugged-251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] Acquiring lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] No waiting events found dispatching network-vif-plugged-251c2317-e6a3-40d8-849b-bec8357be943 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:17 user nova-compute[71516]: WARNING nova.compute.manager [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Received unexpected event network-vif-plugged-251c2317-e6a3-40d8-849b-bec8357be943 for instance with vm_state active and task_state deleting.
Apr 11 23:21:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bFuVroZU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:21:17 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:21:17 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:21:17 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[196f634a-d97c-4898-8a16-648bc639fb54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:21:17 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac2df41-4d58-4b44-979f-1219b456bba3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7] added
Apr 11 23:21:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba90061-b5b2-4375-a2f0-117aab21f338]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[61025112-e4ce-4065-b48a-2eae0260c554]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bFuVroZU {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bFuVroZU" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6820f2fd-4cf2-4f7c-aab6-709906b02378]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bFuVroZU'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b4cfc4-ee58-47eb-85e9-2a4c8458ff46]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c643da-ede4-48ec-8ac7-3c14c4c1a94f]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:17 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:17 user nova-compute[71516]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)
Apr 11 23:21:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:17 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:17 user nova-compute[71516]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)
Apr 11 23:21:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a50f70-5399-4496-b68c-b9a39ce594a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7, portal: 172.16.0.220,3260]
Apr 11 23:21:17 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7, portal: 172.16.0.220,3260] successful.
Apr 11 23:21:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e15ea5c-8543-4509-bcb8-a808595d315d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[040adb1d-af26-4c67-908d-770b0c15f62a]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:17 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:17 user nova-compute[71516]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)
Apr 11 23:21:17 user nova-compute[71516]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 (non-flash)
Apr 11 23:21:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:17 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:17 user nova-compute[71516]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)
Apr 11 23:21:17 user nova-compute[71516]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 (non-flash)
Apr 11 23:21:17 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:17 user nova-compute[71516]: INFO nova.compute.manager [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Took 0.79 seconds to detach 1 volumes for instance.
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[31edce71-3bc5-4c14-8f9f-738462ba364d]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bFuVroZU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:18 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:21:18 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:21:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:18 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Deleted allocations for instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f
Apr 11 23:21:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.124s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:21:18 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23535623739316330', 'path': '/dev/sdd'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:21:18 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535623739316330', 'path': '/dev/sdd'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:21:18 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'flavor' on Instance uuid 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:18 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:21:18 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:21:18 user nova-compute[71516]:   <source dev="/dev/sdd"/>
Apr 11 23:21:18 user nova-compute[71516]:   <target dev="vdc" bus="virtio"/>
Apr 11 23:21:18 user nova-compute[71516]:   <serial>a25d580e-d90b-4acd-b6f2-3108fd4af2a7</serial>
Apr 11 23:21:18 user nova-compute[71516]: </disk>
Apr 11 23:21:18 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:21:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:21:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:21:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:21:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] No VIF found with MAC fa:16:3e:94:77:2a, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:21:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.725s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:20 user nova-compute[71516]: INFO nova.compute.manager [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Detaching volume c70b1197-3dde-4cbe-9034-c0e4dbf636ed
Apr 11 23:21:20 user nova-compute[71516]: INFO nova.virt.block_device [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Attempting to driver detach volume c70b1197-3dde-4cbe-9034-c0e4dbf636ed from mountpoint /dev/vdb
Apr 11 23:21:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Attempting to detach device vdb from instance 5014e85f-b341-4d4d-83f9-6641ee426a46 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:21:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:21:20 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:21:20 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:21:20 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:21:20 user nova-compute[71516]:   <serial>c70b1197-3dde-4cbe-9034-c0e4dbf636ed</serial>
Apr 11 23:21:20 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:21:20 user nova-compute[71516]: </disk>
Apr 11 23:21:20 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:21:20 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully detached device vdb from instance 5014e85f-b341-4d4d-83f9-6641ee426a46 from the persistent domain config.
Apr 11 23:21:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5014e85f-b341-4d4d-83f9-6641ee426a46 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:21:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:21:20 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:21:20 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:21:20 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:21:20 user nova-compute[71516]:   <serial>c70b1197-3dde-4cbe-9034-c0e4dbf636ed</serial>
Apr 11 23:21:20 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:21:20 user nova-compute[71516]: </disk>
Apr 11 23:21:20 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:21:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681255281.1304092, 5014e85f-b341-4d4d-83f9-6641ee426a46 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:21:21 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully detached device vdb from instance 5014e85f-b341-4d4d-83f9-6641ee426a46 from the live domain config.
Apr 11 23:21:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVwDAKXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:21:21 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[184476a9-b5ef-46c1-9b07-badb7a39a135]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:21:21 user nova-compute[71516]: No targets found.
Apr 11 23:21:21 user nova-compute[71516]: iSNS:
Apr 11 23:21:21 user nova-compute[71516]: No targets found.
Apr 11 23:21:21 user nova-compute[71516]: STATIC:
Apr 11 23:21:21 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35
Apr 11 23:21:21 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:21 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:21 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed
Apr 11 23:21:21 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:21 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:21 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7
Apr 11 23:21:21 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:21 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:21 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94
Apr 11 23:21:21 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:21 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:21 user nova-compute[71516]: FIRMWARE:
Apr 11 23:21:21 user nova-compute[71516]: No targets found.
Apr 11 23:21:21 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:21:21 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:21:21 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1e0451-0086-4037-bf8f-54cae168dde5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[055efd3c-b467-4422-a3df-8246ca7c92b9]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:21 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:21 user nova-compute[71516]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)
Apr 11 23:21:21 user nova-compute[71516]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 (non-flash)
Apr 11 23:21:21 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:21 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:21 user nova-compute[71516]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed (non-flash)
Apr 11 23:21:21 user nova-compute[71516]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 (non-flash)
Apr 11 23:21:21 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c140040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f8777c-bb9a-4007-b3cd-9b94b27b5457]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fcb11b-ba4b-4c45-9893-8c9c17435c90]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a73575d-4f5d-4278-b329-d282ffc76b97]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab10a9ab-2c3f-4ed7-8798-7c7c2f521ab7]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[530b3cc9-de19-4074-bd16-49f31be18c20]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d7ec77-ca54-4e7f-8e45-cea4a190274e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed, portal: 172.16.0.220,3260]
Apr 11 23:21:21 user nova-compute[71516]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed, portal: 172.16.0.220,3260] successful.
Apr 11 23:21:21 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70b1197-3dde-4cbe-9034-c0e4dbf636ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ce6656-8635-4969-ba57-c4f3a8b435b2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] <== disconnect_volume: return (320ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:21:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:21:22 user nova-compute[71516]: DEBUG nova.objects.instance [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'flavor' on Instance uuid 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.624s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:23 user nova-compute[71516]: INFO nova.compute.manager [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Detaching volume a25d580e-d90b-4acd-b6f2-3108fd4af2a7
Apr 11 23:21:23 user nova-compute[71516]: INFO nova.virt.block_device [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Attempting to driver detach volume a25d580e-d90b-4acd-b6f2-3108fd4af2a7 from mountpoint /dev/vdc
Apr 11 23:21:23 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Attempting to detach device vdc from instance 5014e85f-b341-4d4d-83f9-6641ee426a46 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:21:23 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:21:23 user nova-compute[71516]:   <source dev="/dev/sdd"/>
Apr 11 23:21:23 user nova-compute[71516]:   <target dev="vdc" bus="virtio"/>
Apr 11 23:21:23 user nova-compute[71516]:   <serial>a25d580e-d90b-4acd-b6f2-3108fd4af2a7</serial>
Apr 11 23:21:23 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 23:21:23 user nova-compute[71516]: </disk>
Apr 11 23:21:23 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:21:23 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully detached device vdc from instance 5014e85f-b341-4d4d-83f9-6641ee426a46 from the persistent domain config.
Apr 11 23:21:23 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5014e85f-b341-4d4d-83f9-6641ee426a46 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:21:23 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:21:23 user nova-compute[71516]:   <source dev="/dev/sdd"/>
Apr 11 23:21:23 user nova-compute[71516]:   <target dev="vdc" bus="virtio"/>
Apr 11 23:21:23 user nova-compute[71516]:   <serial>a25d580e-d90b-4acd-b6f2-3108fd4af2a7</serial>
Apr 11 23:21:23 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 23:21:23 user nova-compute[71516]: </disk>
Apr 11 23:21:23 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681255283.8426738, 5014e85f-b341-4d4d-83f9-6641ee426a46 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:21:23 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully detached device vdc from instance 5014e85f-b341-4d4d-83f9-6641ee426a46 from the live domain config.
Apr 11 23:21:23 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bFuVroZU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:21:23 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:21:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b789dbf-18cd-469c-bca1-348721deee52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:21:23 user nova-compute[71516]: No targets found.
Apr 11 23:21:23 user nova-compute[71516]: iSNS:
Apr 11 23:21:23 user nova-compute[71516]: No targets found.
Apr 11 23:21:23 user nova-compute[71516]: STATIC:
Apr 11 23:21:23 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35
Apr 11 23:21:23 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:23 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:23 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7
Apr 11 23:21:23 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:23 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:23 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94
Apr 11 23:21:23 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:23 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:23 user nova-compute[71516]: FIRMWARE:
Apr 11 23:21:23 user nova-compute[71516]: No targets found.
Apr 11 23:21:23 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:21:23 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:21:23 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aeef42-0d70-47f0-aed5-6b3dd9fbdfda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9fa863-6342-4c99-b79f-e992a83c3d8a]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:23 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:23 user nova-compute[71516]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 (non-flash)
Apr 11 23:21:23 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:23 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:23 user nova-compute[71516]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 (non-flash)
Apr 11 23:21:23 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c43ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7'): ({'sdd'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Removing single pathed devices sdd {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6780a22-a4fd-4017-8f90-2da65405c30d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35e78c3-3b7a-4d9c-9709-0e598a041c5d]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flushing IO for device /dev/sdd {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:21:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0796d8-6903-4bf1-b0f2-99258c7f045a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[592ae28d-b200-4eed-8d6a-faee878777a3]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0739784d-6094-47a8-aca4-b1e0abd6758a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd41091-f15e-4ea1-94cc-0565ea0d9a85]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7, portal: 172.16.0.220,3260]
Apr 11 23:21:24 user nova-compute[71516]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7, portal: 172.16.0.220,3260] successful.
Apr 11 23:21:24 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25d580e-d90b-4acd-b6f2-3108fd4af2a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8dc480-600b-47a7-92c5-d42b4db20e13]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] <== disconnect_volume: return (309ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:21:24 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'flavor' on Instance uuid 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.799s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:25 user nova-compute[71516]: INFO nova.compute.manager [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Terminating instance
Apr 11 23:21:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:21:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-6642fb36-d6f1-4b3e-bf52-3513515e3ffe req-33709f11-3b9b-45c2-a7e9-0f021ff5feea service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Received event network-vif-unplugged-484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6642fb36-d6f1-4b3e-bf52-3513515e3ffe req-33709f11-3b9b-45c2-a7e9-0f021ff5feea service nova] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6642fb36-d6f1-4b3e-bf52-3513515e3ffe req-33709f11-3b9b-45c2-a7e9-0f021ff5feea service nova] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6642fb36-d6f1-4b3e-bf52-3513515e3ffe req-33709f11-3b9b-45c2-a7e9-0f021ff5feea service nova] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-6642fb36-d6f1-4b3e-bf52-3513515e3ffe req-33709f11-3b9b-45c2-a7e9-0f021ff5feea service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] No waiting events found dispatching network-vif-unplugged-484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-6642fb36-d6f1-4b3e-bf52-3513515e3ffe req-33709f11-3b9b-45c2-a7e9-0f021ff5feea service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Received event network-vif-unplugged-484a65b3-2e3e-4c0c-8035-c002575411ba for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:21:26 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Instance destroyed successfully.
Apr 11 23:21:26 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'resources' on Instance uuid 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1752444058',display_name='tempest-AttachVolumeTestJSON-server-1752444058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1752444058',id=34,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd6J9Hfhfl3k6suA3VXx505Hz3ymCZc6NkXJqG6wdldGsvO/ASBV5wMoZFTIiO5UnutLW+qfE9dn9LQpAB0adzm2fiHkMxgQ9UOrhoV8PdfuFDGyKYzVyo6Y9veMg9JWg==',key_name='tempest-keypair-1733576032',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:19:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0ff3d48596a44f8ac8d9306becd8178',ramdisk_id='',reservation_id='r-yrdt40r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-343820803',owner_user_name='tempest-AttachVolumeTestJSON-343820803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:19:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1793cec543e8425899474614b2c10f5d',uuid=5014e85f-b341-4d4d-83f9-6641ee426a46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "484a65b3-2e3e-4c0c-8035-c002575411ba", "address": "fa:16:3e:94:77:2a", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484a65b3-2e", "ovs_interfaceid": "484a65b3-2e3e-4c0c-8035-c002575411ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converting VIF {"id": "484a65b3-2e3e-4c0c-8035-c002575411ba", "address": "fa:16:3e:94:77:2a", "network": {"id": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-643567218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0ff3d48596a44f8ac8d9306becd8178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484a65b3-2e", "ovs_interfaceid": "484a65b3-2e3e-4c0c-8035-c002575411ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:77:2a,bridge_name='br-int',has_traffic_filtering=True,id=484a65b3-2e3e-4c0c-8035-c002575411ba,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484a65b3-2e') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG os_vif [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:77:2a,bridge_name='br-int',has_traffic_filtering=True,id=484a65b3-2e3e-4c0c-8035-c002575411ba,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484a65b3-2e') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap484a65b3-2e, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:21:26 user nova-compute[71516]: INFO os_vif [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:77:2a,bridge_name='br-int',has_traffic_filtering=True,id=484a65b3-2e3e-4c0c-8035-c002575411ba,network=Network(c4d6de35-af1a-4dd1-9efe-b1b10bbcc909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484a65b3-2e')
Apr 11 23:21:26 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Deleting instance files /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46_del
Apr 11 23:21:26 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Deletion of /opt/stack/data/nova/instances/5014e85f-b341-4d4d-83f9-6641ee426a46_del complete
Apr 11 23:21:26 user nova-compute[71516]: INFO nova.compute.manager [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 11 23:21:26 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:21:26 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:21:27 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:27 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Took 0.89 seconds to deallocate network for instance.
Apr 11 23:21:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:27 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:21:27 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:21:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.603s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Received event network-vif-plugged-484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] Acquiring lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] No waiting events found dispatching network-vif-plugged-484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:28 user nova-compute[71516]: WARNING nova.compute.manager [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Received unexpected event network-vif-plugged-484a65b3-2e3e-4c0c-8035-c002575411ba for instance with vm_state deleted and task_state None.
Apr 11 23:21:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Received event network-vif-deleted-484a65b3-2e3e-4c0c-8035-c002575411ba {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:28 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Deleted allocations for instance 5014e85f-b341-4d4d-83f9-6641ee426a46
Apr 11 23:21:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "5014e85f-b341-4d4d-83f9-6641ee426a46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.497s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "546a073f-3860-4aea-9da5-713d87a3762e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255276.066089, f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:21:31 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] VM Stopped (Lifecycle Event)
Apr 11 23:21:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-235fa264-f40b-4bcf-a1e6-7fd67f10df22 None None] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:21:31 user nova-compute[71516]: INFO nova.compute.claims [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Claim successful on node user
Apr 11 23:21:31 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:21:31 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:21:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG nova.policy [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:21:31 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Creating image(s)
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "/opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "/opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "/opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:31 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk 1073741824" returned: 0 in 0.047s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Cannot resize image /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'migration_context' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Ensure instance console log exists: /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Successfully created port: 76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Successfully updated port: 76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquired lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG nova.compute.manager [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-changed-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG nova.compute.manager [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Refreshing instance network info cache due to event network-changed-76adadaa-820a-4fa5-b837-6ef514aa0b8f. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] Acquiring lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updating instance_info_cache with network_info: [{"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Releasing lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Instance network_info: |[{"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] Acquired lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG nova.network.neutron [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Refreshing network info cache for port 76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:21:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Start _get_guest_xml network_info=[{"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:21:33 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:21:33 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:21:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1543973671',display_name='tempest-ServerRescueNegativeTestJSON-server-1543973671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1543973671',id=37,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrGcGiE4e6Tp38+exR5YT3oDXkSl1ZsauX2FXZ9tTkUu/HLi16m9tlHlzQu5NVP1uorNPN1lADTpqYHlQH1A6/c0JnTeih3uliLzgAEFHnvGzYHnPpZKyFHC5IeclDOHA==',key_name='tempest-keypair-1207488062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31c373270f804948a04c8125848fa181',ramdisk_id='',reservation_id='r-6681j8m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-242021724',owner_user_name='tempest-ServerRescueNegativeTestJSON-242021724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:21:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d63779eda794ef0b2413ac1483f88b8',uuid=546a073f-3860-4aea-9da5-713d87a3762e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converting VIF {"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=76adadaa-820a-4fa5-b837-6ef514aa0b8f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adadaa-82') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'pci_devices' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:21:34 user nova-compute[71516]:   <uuid>546a073f-3860-4aea-9da5-713d87a3762e</uuid>
Apr 11 23:21:34 user nova-compute[71516]:   <name>instance-00000025</name>
Apr 11 23:21:34 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:21:34 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:21:34 user nova-compute[71516]:   <metadata>
Apr 11 23:21:34 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:21:34 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:21:34 user nova-compute[71516]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1543973671</nova:name>
Apr 11 23:21:34 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:21:33</nova:creationTime>
Apr 11 23:21:34 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:21:34 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:21:34 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:21:34 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:21:34 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:21:34 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:21:34 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:21:34 user nova-compute[71516]:       <nova:owner>
Apr 11 23:21:34 user nova-compute[71516]:         <nova:user uuid="8d63779eda794ef0b2413ac1483f88b8">tempest-ServerRescueNegativeTestJSON-242021724-project-member</nova:user>
Apr 11 23:21:34 user nova-compute[71516]:         <nova:project uuid="31c373270f804948a04c8125848fa181">tempest-ServerRescueNegativeTestJSON-242021724</nova:project>
Apr 11 23:21:34 user nova-compute[71516]:       </nova:owner>
Apr 11 23:21:34 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:21:34 user nova-compute[71516]:       <nova:ports>
Apr 11 23:21:34 user nova-compute[71516]:         <nova:port uuid="76adadaa-820a-4fa5-b837-6ef514aa0b8f">
Apr 11 23:21:34 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 23:21:34 user nova-compute[71516]:         </nova:port>
Apr 11 23:21:34 user nova-compute[71516]:       </nova:ports>
Apr 11 23:21:34 user nova-compute[71516]:     </nova:instance>
Apr 11 23:21:34 user nova-compute[71516]:   </metadata>
Apr 11 23:21:34 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:21:34 user nova-compute[71516]:     <system>
Apr 11 23:21:34 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:21:34 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:21:34 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:21:34 user nova-compute[71516]:       <entry name="serial">546a073f-3860-4aea-9da5-713d87a3762e</entry>
Apr 11 23:21:34 user nova-compute[71516]:       <entry name="uuid">546a073f-3860-4aea-9da5-713d87a3762e</entry>
Apr 11 23:21:34 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:21:34 user nova-compute[71516]:     </system>
Apr 11 23:21:34 user nova-compute[71516]:   </sysinfo>
Apr 11 23:21:34 user nova-compute[71516]:   <os>
Apr 11 23:21:34 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:21:34 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:21:34 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:21:34 user nova-compute[71516]:   </os>
Apr 11 23:21:34 user nova-compute[71516]:   <features>
Apr 11 23:21:34 user nova-compute[71516]:     <acpi/>
Apr 11 23:21:34 user nova-compute[71516]:     <apic/>
Apr 11 23:21:34 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:21:34 user nova-compute[71516]:   </features>
Apr 11 23:21:34 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:21:34 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:21:34 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:21:34 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:21:34 user nova-compute[71516]:   </clock>
Apr 11 23:21:34 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:21:34 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:21:34 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:21:34 user nova-compute[71516]:   </cpu>
Apr 11 23:21:34 user nova-compute[71516]:   <devices>
Apr 11 23:21:34 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:21:34 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:21:34 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk"/>
Apr 11 23:21:34 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:21:34 user nova-compute[71516]:     </disk>
Apr 11 23:21:34 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:21:34 user nova-compute[71516]:       <mac address="fa:16:3e:7a:74:8a"/>
Apr 11 23:21:34 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:21:34 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:21:34 user nova-compute[71516]:       <target dev="tap76adadaa-82"/>
Apr 11 23:21:34 user nova-compute[71516]:     </interface>
Apr 11 23:21:34 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:21:34 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/console.log" append="off"/>
Apr 11 23:21:34 user nova-compute[71516]:     </serial>
Apr 11 23:21:34 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:21:34 user nova-compute[71516]:     <video>
Apr 11 23:21:34 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:21:34 user nova-compute[71516]:     </video>
Apr 11 23:21:34 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:21:34 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:21:34 user nova-compute[71516]:     </rng>
Apr 11 23:21:34 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:21:34 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:21:34 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:21:34 user nova-compute[71516]:     </memballoon>
Apr 11 23:21:34 user nova-compute[71516]:   </devices>
Apr 11 23:21:34 user nova-compute[71516]: </domain>
Apr 11 23:21:34 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1543973671',display_name='tempest-ServerRescueNegativeTestJSON-server-1543973671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1543973671',id=37,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrGcGiE4e6Tp38+exR5YT3oDXkSl1ZsauX2FXZ9tTkUu/HLi16m9tlHlzQu5NVP1uorNPN1lADTpqYHlQH1A6/c0JnTeih3uliLzgAEFHnvGzYHnPpZKyFHC5IeclDOHA==',key_name='tempest-keypair-1207488062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31c373270f804948a04c8125848fa181',ramdisk_id='',reservation_id='r-6681j8m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-242021724',owner_user_name='tempest-ServerRescueNegativeTestJSON-242021724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:21:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d63779eda794ef0b2413ac1483f88b8',uuid=546a073f-3860-4aea-9da5-713d87a3762e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converting VIF {"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=76adadaa-820a-4fa5-b837-6ef514aa0b8f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adadaa-82') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG os_vif [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=76adadaa-820a-4fa5-b837-6ef514aa0b8f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adadaa-82') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76adadaa-82, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76adadaa-82, col_values=(('external_ids', {'iface-id': '76adadaa-820a-4fa5-b837-6ef514aa0b8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:74:8a', 'vm-uuid': '546a073f-3860-4aea-9da5-713d87a3762e'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:34 user nova-compute[71516]: INFO os_vif [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=76adadaa-820a-4fa5-b837-6ef514aa0b8f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adadaa-82')
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No VIF found with MAC fa:16:3e:7a:74:8a, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.network.neutron [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updated VIF entry in instance network info cache for port 76adadaa-820a-4fa5-b837-6ef514aa0b8f. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG nova.network.neutron [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updating instance_info_cache with network_info: [{"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] Releasing lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-7646a11c-811d-4462-b01a-6c6b3b5c72f0 req-415f9748-9987-4ee3-b570-2bfd49cd4c06 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7646a11c-811d-4462-b01a-6c6b3b5c72f0 req-415f9748-9987-4ee3-b570-2bfd49cd4c06 service nova] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7646a11c-811d-4462-b01a-6c6b3b5c72f0 req-415f9748-9987-4ee3-b570-2bfd49cd4c06 service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7646a11c-811d-4462-b01a-6c6b3b5c72f0 req-415f9748-9987-4ee3-b570-2bfd49cd4c06 service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-7646a11c-811d-4462-b01a-6c6b3b5c72f0 req-415f9748-9987-4ee3-b570-2bfd49cd4c06 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] No waiting events found dispatching network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:35 user nova-compute[71516]: WARNING nova.compute.manager [req-7646a11c-811d-4462-b01a-6c6b3b5c72f0 req-415f9748-9987-4ee3-b570-2bfd49cd4c06 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received unexpected event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance with vm_state building and task_state spawning.
Apr 11 23:21:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updating instance_info_cache with network_info: [{"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:21:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255297.626837, 546a073f-3860-4aea-9da5-713d87a3762e => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:21:37 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] VM Resumed (Lifecycle Event)
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:21:37 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Instance spawned successfully.
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-65233097-e7c3-4970-bda2-0231fb571fc9 req-6a18050b-84bf-4ae1-b644-cbdb1bce9b8e service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-65233097-e7c3-4970-bda2-0231fb571fc9 req-6a18050b-84bf-4ae1-b644-cbdb1bce9b8e service nova] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-65233097-e7c3-4970-bda2-0231fb571fc9 req-6a18050b-84bf-4ae1-b644-cbdb1bce9b8e service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-65233097-e7c3-4970-bda2-0231fb571fc9 req-6a18050b-84bf-4ae1-b644-cbdb1bce9b8e service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-65233097-e7c3-4970-bda2-0231fb571fc9 req-6a18050b-84bf-4ae1-b644-cbdb1bce9b8e service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] No waiting events found dispatching network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:37 user nova-compute[71516]: WARNING nova.compute.manager [req-65233097-e7c3-4970-bda2-0231fb571fc9 req-6a18050b-84bf-4ae1-b644-cbdb1bce9b8e service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received unexpected event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance with vm_state building and task_state spawning.
Apr 11 23:21:37 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255297.6305091, 546a073f-3860-4aea-9da5-713d87a3762e => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:21:37 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] VM Started (Lifecycle Event)
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:21:37 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:21:37 user nova-compute[71516]: INFO nova.compute.manager [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Took 6.14 seconds to spawn the instance on the hypervisor.
Apr 11 23:21:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:37 user nova-compute[71516]: INFO nova.compute.manager [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Took 6.90 seconds to build instance.
Apr 11 23:21:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "546a073f-3860-4aea-9da5-713d87a3762e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.030s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:38 user nova-compute[71516]: INFO nova.compute.manager [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Terminating instance
Apr 11 23:21:38 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:38 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-e5786168-6c1a-4fc3-b0e4-22e532b39507 req-30564b7d-5794-4890-907b-996fe043448d service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-vif-unplugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e5786168-6c1a-4fc3-b0e4-22e532b39507 req-30564b7d-5794-4890-907b-996fe043448d service nova] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e5786168-6c1a-4fc3-b0e4-22e532b39507 req-30564b7d-5794-4890-907b-996fe043448d service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e5786168-6c1a-4fc3-b0e4-22e532b39507 req-30564b7d-5794-4890-907b-996fe043448d service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-e5786168-6c1a-4fc3-b0e4-22e532b39507 req-30564b7d-5794-4890-907b-996fe043448d service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] No waiting events found dispatching network-vif-unplugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-e5786168-6c1a-4fc3-b0e4-22e532b39507 req-30564b7d-5794-4890-907b-996fe043448d service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-vif-unplugged-86961f23-bd39-44da-8ad9-4420b80e9223 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:39 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Instance destroyed successfully.
Apr 11 23:21:39 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'resources' on Instance uuid 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1117768809',display_name='tempest-TestMinimumBasicScenario-server-1117768809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1117768809',id=30,image_ref='61c0c235-6d9e-44b6-aaf7-5005b1f3aba4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTEcgl/NhGv4Bb/P05E6qwS4i7frnTq227Fw8NjjabwTORj5LZJIXHiu7YOkH/BFyO3Oi3ku/v20lt1w55I01gZuEaexPUI/f5ofEy7HOCw5kg1vykKtzfwLhsywN4pww==',key_name='tempest-TestMinimumBasicScenario-1640213672',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e8e126b69d44b27a60c421b86b79e9f',ramdisk_id='',reservation_id='r-p37n1zc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61c0c235-6d9e-44b6-aaf7-5005b1f3aba4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1152745105',owner_user_name='tempest-TestMinimumBasicScenario-1152745105-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:19:00Z,user_data=None,user_id='6beb3cae81a14fa2bae48a8eedcb3868',uuid=1fec2e5a-e0bf-435d-822b-766c8c2f2d9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converting VIF {"id": "86961f23-bd39-44da-8ad9-4420b80e9223", "address": "fa:16:3e:41:3b:05", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86961f23-bd", "ovs_interfaceid": "86961f23-bd39-44da-8ad9-4420b80e9223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG os_vif [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86961f23-bd, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:21:39 user nova-compute[71516]: INFO os_vif [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=86961f23-bd39-44da-8ad9-4420b80e9223,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86961f23-bd')
Apr 11 23:21:39 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Deleting instance files /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c_del
Apr 11 23:21:39 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Deletion of /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c_del complete
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json" returned: 1 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk --force-share --output=json' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:21:39 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001e, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/disk
Apr 11 23:21:39 user nova-compute[71516]: INFO nova.compute.manager [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:40 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:21:40 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=7811MB free_disk=26.18906021118164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:40 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Took 0.86 seconds to deallocate network for instance.
Apr 11 23:21:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance b007f35d-b7e1-401f-8b11-37eda193e79b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance de7744d0-487a-49be-9355-fcf1266af37f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 546a073f-3860-4aea-9da5-713d87a3762e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.349s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] Acquiring lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] No waiting events found dispatching network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:41 user nova-compute[71516]: WARNING nova.compute.manager [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received unexpected event network-vif-plugged-86961f23-bd39-44da-8ad9-4420b80e9223 for instance with vm_state deleted and task_state None.
Apr 11 23:21:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Received event network-vif-deleted-86961f23-bd39-44da-8ad9-4420b80e9223 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:41 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Deleted allocations for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c
Apr 11 23:21:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.633s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255286.5854628, 5014e85f-b341-4d4d-83f9-6641ee426a46 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:21:41 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] VM Stopped (Lifecycle Event)
Apr 11 23:21:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ff33e042-66d6-458e-8d3a-04daac346081 None None] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:21:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-changed-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Refreshing instance network info cache due to event network-changed-5bd8ff97-1370-4a98-8111-ac1c6635a9ee. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] Acquiring lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] Acquired lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG nova.network.neutron [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Refreshing network info cache for port 5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:44 user nova-compute[71516]: INFO nova.compute.manager [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Terminating instance
Apr 11 23:21:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-f4ac8bf1-bc34-464a-9ed3-56a8eb04a20e req-9e4b4777-0126-44a4-81d7-769833123d20 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-vif-unplugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f4ac8bf1-bc34-464a-9ed3-56a8eb04a20e req-9e4b4777-0126-44a4-81d7-769833123d20 service nova] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f4ac8bf1-bc34-464a-9ed3-56a8eb04a20e req-9e4b4777-0126-44a4-81d7-769833123d20 service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f4ac8bf1-bc34-464a-9ed3-56a8eb04a20e req-9e4b4777-0126-44a4-81d7-769833123d20 service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-f4ac8bf1-bc34-464a-9ed3-56a8eb04a20e req-9e4b4777-0126-44a4-81d7-769833123d20 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] No waiting events found dispatching network-vif-unplugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-f4ac8bf1-bc34-464a-9ed3-56a8eb04a20e req-9e4b4777-0126-44a4-81d7-769833123d20 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-vif-unplugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG nova.network.neutron [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updated VIF entry in instance network info cache for port 5bd8ff97-1370-4a98-8111-ac1c6635a9ee. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG nova.network.neutron [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updating instance_info_cache with network_info: [{"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] Releasing lock "refresh_cache-8d9f6a0d-caab-4f42-a9b1-a4653b90559f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:45 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Instance destroyed successfully.
Apr 11 23:21:45 user nova-compute[71516]: DEBUG nova.objects.instance [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lazy-loading 'resources' on Instance uuid 8d9f6a0d-caab-4f42-a9b1-a4653b90559f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T23:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1643016946',display_name='tempest-TestShelveInstance-server-1643016946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1643016946',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgAA/M8o66n0P5gxuVKww0/BCxA0rUaiV6ohdeuypE0j3Kmiiiuava13qXCYccyFsmSc/AuIKI2xHRcKEGO3MwIJuyx6Z95uIU1juqzY2j0pbX2+qlSqsiVm9Z0Pwdf/A==',key_name='tempest-TestShelveInstance-1561116455',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:20:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3252362661dd4f8c9ad6298048a84c6a',ramdisk_id='',reservation_id='r-k4wk8wut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-932398179',owner_user_name='tempest-TestShelveInstance-932398179-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:20:05Z,user_data=None,user_id='acfb7fc33f4e4694bcc224292ac5f231',uuid=8d9f6a0d-caab-4f42-a9b1-a4653b90559f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Converting VIF {"id": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "address": "fa:16:3e:59:76:73", "network": {"id": "843752b3-92e7-499c-a2fc-b924b39ada9e", "bridge": "br-int", "label": "tempest-TestShelveInstance-433982972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3252362661dd4f8c9ad6298048a84c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8ff97-13", "ovs_interfaceid": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_vif [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bd8ff97-13, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:45 user nova-compute[71516]: INFO os_vif [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:76:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8ff97-1370-4a98-8111-ac1c6635a9ee,network=Network(843752b3-92e7-499c-a2fc-b924b39ada9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8ff97-13')
Apr 11 23:21:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePzEAZJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:21:45 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a312f4a-7f1c-4263-8024-98286c243d8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:21:45 user nova-compute[71516]: No targets found.
Apr 11 23:21:45 user nova-compute[71516]: iSNS:
Apr 11 23:21:45 user nova-compute[71516]: No targets found.
Apr 11 23:21:45 user nova-compute[71516]: STATIC:
Apr 11 23:21:45 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35
Apr 11 23:21:45 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:45 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:45 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94
Apr 11 23:21:45 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:21:45 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:21:45 user nova-compute[71516]: FIRMWARE:
Apr 11 23:21:45 user nova-compute[71516]: No targets found.
Apr 11 23:21:45 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:21:45 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:21:45 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcb3195-2306-4264-9fc8-fdf6eb54bc15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06d40de-aa32-4d7b-88c3-b89dc4d67327]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:45 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:45 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 (non-flash)
Apr 11 23:21:45 user nova-compute[71516]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:21:45 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c79d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94'): ({'sde'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Removing single pathed devices sde {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d99939-8f36-4b52-9fe7-85122a89aa7a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5c978b-9820-45fd-8421-350fd409f976]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Flushing IO for device /dev/sde {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1667418-a723-4b7f-923f-54990ab328cc]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b1b20b-8a47-4a35-a34d-ba8d0c991ef5]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5f2bac78-b83d76627c43f937', '/dev/disk/by-id/scsi-26238336437363632', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5f2bac78') {{(pid=81691) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9b680e-3c9c-4b6b-9c37-c89b23ad396c]: (4, None) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8760c40-bcef-41ca-acfd-2b1c365c32ba]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a41195-a0b6-48ba-bf66-f742b47d3de4]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260]
Apr 11 23:21:45 user nova-compute[71516]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94, portal: 172.16.0.220,3260] successful.
Apr 11 23:21:45 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a123772-084e-4d54-b2e1-a1f651f24250]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] <== disconnect_volume: return (295ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:21:45 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Deleting instance files /opt/stack/data/nova/instances/8d9f6a0d-caab-4f42-a9b1-a4653b90559f_del
Apr 11 23:21:45 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Deletion of /opt/stack/data/nova/instances/8d9f6a0d-caab-4f42-a9b1-a4653b90559f_del complete
Apr 11 23:21:45 user nova-compute[71516]: INFO nova.compute.manager [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 11 23:21:45 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:21:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:46 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:46 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Took 0.46 seconds to deallocate network for instance.
Apr 11 23:21:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-5b765d22-f6ee-4123-8f04-82b3d416e007 req-08760e54-9320-48c2-b3d0-2bcc370f19c6 service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-vif-deleted-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:47 user nova-compute[71516]: DEBUG nova.compute.manager [req-d052e9b7-e6bc-4f93-a37e-bae405c7a3c9 req-bcc5146f-fe2a-4b6b-8765-a16fd7db8c2f service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received event network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d052e9b7-e6bc-4f93-a37e-bae405c7a3c9 req-bcc5146f-fe2a-4b6b-8765-a16fd7db8c2f service nova] Acquiring lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d052e9b7-e6bc-4f93-a37e-bae405c7a3c9 req-bcc5146f-fe2a-4b6b-8765-a16fd7db8c2f service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d052e9b7-e6bc-4f93-a37e-bae405c7a3c9 req-bcc5146f-fe2a-4b6b-8765-a16fd7db8c2f service nova] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:47 user nova-compute[71516]: DEBUG nova.compute.manager [req-d052e9b7-e6bc-4f93-a37e-bae405c7a3c9 req-bcc5146f-fe2a-4b6b-8765-a16fd7db8c2f service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] No waiting events found dispatching network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:47 user nova-compute[71516]: WARNING nova.compute.manager [req-d052e9b7-e6bc-4f93-a37e-bae405c7a3c9 req-bcc5146f-fe2a-4b6b-8765-a16fd7db8c2f service nova] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Received unexpected event network-vif-plugged-5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance with vm_state active and task_state deleting.
Apr 11 23:21:47 user nova-compute[71516]: INFO nova.compute.manager [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Took 0.83 seconds to detach 1 volumes for instance.
Apr 11 23:21:47 user nova-compute[71516]: DEBUG nova.compute.manager [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Deleting volume: 1ba1bebe-9c96-4eb9-813a-593d2a5a4d94 {{(pid=71516) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 23:21:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:47 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:21:47 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:21:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:47 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Deleted allocations for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f
Apr 11 23:21:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "8d9f6a0d-caab-4f42-a9b1-a4653b90559f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.953s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:50 user nova-compute[71516]: INFO nova.compute.manager [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Terminating instance
Apr 11 23:21:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:21:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:51 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Instance destroyed successfully.
Apr 11 23:21:51 user nova-compute[71516]: DEBUG nova.objects.instance [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'resources' on Instance uuid bd78e8ee-ec6a-4de8-8146-bd37787b5c2c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-970474155',display_name='tempest-AttachVolumeNegativeTest-server-970474155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-970474155',id=32,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhRiArT29Rv92Wh1N2Mt98TPn5xlam31Hu8Z75IA4+J6QNB3eeaIWgcW3gwaUMUpR1wXJRGFbU5LHD1vOHhxsWwkp54eRAOxnFQP1vQNXofezaTxUI9CI1Kb2w/uTa/Qw==',key_name='tempest-keypair-1508967452',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:19:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f29d28c472c4f65b8437ce443d208c7',ramdisk_id='',reservation_id='r-crctdfv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2123485934',owner_user_name='tempest-AttachVolumeNegativeTest-2123485934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da1389f3e27f49f394598636d041a9c9',uuid=bd78e8ee-ec6a-4de8-8146-bd37787b5c2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "address": "fa:16:3e:17:84:71", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f30c94-ec", "ovs_interfaceid": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converting VIF {"id": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "address": "fa:16:3e:17:84:71", "network": {"id": "f013a872-a4db-4d26-8b73-353db89b647e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-83458246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f29d28c472c4f65b8437ce443d208c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f30c94-ec", "ovs_interfaceid": "79f30c94-ec16-4a33-b97e-639ce9a383c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:84:71,bridge_name='br-int',has_traffic_filtering=True,id=79f30c94-ec16-4a33-b97e-639ce9a383c8,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f30c94-ec') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG os_vif [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:84:71,bridge_name='br-int',has_traffic_filtering=True,id=79f30c94-ec16-4a33-b97e-639ce9a383c8,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f30c94-ec') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-7fb49c68-87b5-457e-9108-27bce87443e5 req-3e82bf9f-f6bf-4090-aa02-4e918ad3d4f0 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received event network-vif-unplugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7fb49c68-87b5-457e-9108-27bce87443e5 req-3e82bf9f-f6bf-4090-aa02-4e918ad3d4f0 service nova] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7fb49c68-87b5-457e-9108-27bce87443e5 req-3e82bf9f-f6bf-4090-aa02-4e918ad3d4f0 service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7fb49c68-87b5-457e-9108-27bce87443e5 req-3e82bf9f-f6bf-4090-aa02-4e918ad3d4f0 service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-7fb49c68-87b5-457e-9108-27bce87443e5 req-3e82bf9f-f6bf-4090-aa02-4e918ad3d4f0 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] No waiting events found dispatching network-vif-unplugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-7fb49c68-87b5-457e-9108-27bce87443e5 req-3e82bf9f-f6bf-4090-aa02-4e918ad3d4f0 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received event network-vif-unplugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79f30c94-ec, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:21:51 user nova-compute[71516]: INFO os_vif [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:84:71,bridge_name='br-int',has_traffic_filtering=True,id=79f30c94-ec16-4a33-b97e-639ce9a383c8,network=Network(f013a872-a4db-4d26-8b73-353db89b647e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f30c94-ec')
Apr 11 23:21:51 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Deleting instance files /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c_del
Apr 11 23:21:51 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Deletion of /opt/stack/data/nova/instances/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c_del complete
Apr 11 23:21:51 user nova-compute[71516]: INFO nova.compute.manager [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 11 23:21:51 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:21:51 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:21:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:52 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-0eff57ab-9de6-47fb-8810-e981201f974e req-7379182f-b3a4-47c3-bd9a-f96d50d3b845 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received event network-vif-deleted-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:52 user nova-compute[71516]: INFO nova.compute.manager [req-0eff57ab-9de6-47fb-8810-e981201f974e req-7379182f-b3a4-47c3-bd9a-f96d50d3b845 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Neutron deleted interface 79f30c94-ec16-4a33-b97e-639ce9a383c8; detaching it from the instance and deleting it from the info cache
Apr 11 23:21:52 user nova-compute[71516]: DEBUG nova.network.neutron [req-0eff57ab-9de6-47fb-8810-e981201f974e req-7379182f-b3a4-47c3-bd9a-f96d50d3b845 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:21:52 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Took 0.98 seconds to deallocate network for instance.
Apr 11 23:21:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-0eff57ab-9de6-47fb-8810-e981201f974e req-7379182f-b3a4-47c3-bd9a-f96d50d3b845 service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Detach interface failed, port_id=79f30c94-ec16-4a33-b97e-639ce9a383c8, reason: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:21:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:53 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Deleted allocations for instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.319s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received event network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] No waiting events found dispatching network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:53 user nova-compute[71516]: WARNING nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received unexpected event network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance with vm_state deleted and task_state None.
Apr 11 23:21:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received event network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] No waiting events found dispatching network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:53 user nova-compute[71516]: WARNING nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received unexpected event network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance with vm_state deleted and task_state None.
Apr 11 23:21:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received event network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] No waiting events found dispatching network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:53 user nova-compute[71516]: WARNING nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received unexpected event network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance with vm_state deleted and task_state None.
Apr 11 23:21:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received event network-vif-unplugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] No waiting events found dispatching network-vif-unplugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:53 user nova-compute[71516]: WARNING nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received unexpected event network-vif-unplugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance with vm_state deleted and task_state None.
Apr 11 23:21:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received event network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Acquiring lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Lock "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:21:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] No waiting events found dispatching network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:21:53 user nova-compute[71516]: WARNING nova.compute.manager [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Received unexpected event network-vif-plugged-79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance with vm_state deleted and task_state None.
Apr 11 23:21:54 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255299.5175, 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:21:54 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] VM Stopped (Lifecycle Event)
Apr 11 23:21:54 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c2e9392b-e4be-4c8c-9c84-11908a95e89b None None] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:21:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:21:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:00 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255305.4300623, 8d9f6a0d-caab-4f42-a9b1-a4653b90559f => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:22:00 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] VM Stopped (Lifecycle Event)
Apr 11 23:22:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-e73a54e9-1f1d-41ba-afa9-4592b3ef7ac9 None None] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:22:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:22:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "b007f35d-b7e1-401f-8b11-37eda193e79b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:02 user nova-compute[71516]: INFO nova.compute.manager [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Terminating instance
Apr 11 23:22:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:22:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:02 user nova-compute[71516]: DEBUG nova.compute.manager [req-845a6343-0d88-4d32-b4d0-2ae6fae5c21e req-22d8179e-9e62-481d-a52f-308a50821726 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Received event network-vif-unplugged-7a39b637-85b5-46da-b7f4-1754f2f38325 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:22:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-845a6343-0d88-4d32-b4d0-2ae6fae5c21e req-22d8179e-9e62-481d-a52f-308a50821726 service nova] Acquiring lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-845a6343-0d88-4d32-b4d0-2ae6fae5c21e req-22d8179e-9e62-481d-a52f-308a50821726 service nova] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-845a6343-0d88-4d32-b4d0-2ae6fae5c21e req-22d8179e-9e62-481d-a52f-308a50821726 service nova] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:02 user nova-compute[71516]: DEBUG nova.compute.manager [req-845a6343-0d88-4d32-b4d0-2ae6fae5c21e req-22d8179e-9e62-481d-a52f-308a50821726 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] No waiting events found dispatching network-vif-unplugged-7a39b637-85b5-46da-b7f4-1754f2f38325 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:22:02 user nova-compute[71516]: DEBUG nova.compute.manager [req-845a6343-0d88-4d32-b4d0-2ae6fae5c21e req-22d8179e-9e62-481d-a52f-308a50821726 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Received event network-vif-unplugged-7a39b637-85b5-46da-b7f4-1754f2f38325 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:22:03 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Instance destroyed successfully.
Apr 11 23:22:03 user nova-compute[71516]: DEBUG nova.objects.instance [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lazy-loading 'resources' on Instance uuid b007f35d-b7e1-401f-8b11-37eda193e79b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1726484212',display_name='tempest-VolumesActionsTest-instance-1726484212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1726484212',id=35,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39bb15903c1c49fba14bf5e1c4a1556b',ramdisk_id='',reservation_id='r-y3tv5nkz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1880276817',owner_user_name='tempest-VolumesActionsTest-1880276817-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:20:14Z,user_data=None,user_id='472822fb18a1486993fdfd21429a6823',uuid=b007f35d-b7e1-401f-8b11-37eda193e79b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a39b637-85b5-46da-b7f4-1754f2f38325", "address": "fa:16:3e:5b:4b:17", "network": {"id": "69caf2c0-0a84-49e1-84cb-6be694771eff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-626254533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "39bb15903c1c49fba14bf5e1c4a1556b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a39b637-85", "ovs_interfaceid": "7a39b637-85b5-46da-b7f4-1754f2f38325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Converting VIF {"id": "7a39b637-85b5-46da-b7f4-1754f2f38325", "address": "fa:16:3e:5b:4b:17", "network": {"id": "69caf2c0-0a84-49e1-84cb-6be694771eff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-626254533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "39bb15903c1c49fba14bf5e1c4a1556b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a39b637-85", "ovs_interfaceid": "7a39b637-85b5-46da-b7f4-1754f2f38325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4b:17,bridge_name='br-int',has_traffic_filtering=True,id=7a39b637-85b5-46da-b7f4-1754f2f38325,network=Network(69caf2c0-0a84-49e1-84cb-6be694771eff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a39b637-85') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG os_vif [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4b:17,bridge_name='br-int',has_traffic_filtering=True,id=7a39b637-85b5-46da-b7f4-1754f2f38325,network=Network(69caf2c0-0a84-49e1-84cb-6be694771eff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a39b637-85') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a39b637-85, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:22:03 user nova-compute[71516]: INFO os_vif [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4b:17,bridge_name='br-int',has_traffic_filtering=True,id=7a39b637-85b5-46da-b7f4-1754f2f38325,network=Network(69caf2c0-0a84-49e1-84cb-6be694771eff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a39b637-85')
Apr 11 23:22:03 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Deleting instance files /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b_del
Apr 11 23:22:03 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Deletion of /opt/stack/data/nova/instances/b007f35d-b7e1-401f-8b11-37eda193e79b_del complete
Apr 11 23:22:03 user nova-compute[71516]: INFO nova.compute.manager [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 11 23:22:03 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:03 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Took 0.54 seconds to deallocate network for instance.
Apr 11 23:22:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-4dd41077-a902-4a45-9fcd-079b6bfc95ca req-807fee91-4e02-4ad9-97a0-291e542d3e5d service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Received event network-vif-deleted-7a39b637-85b5-46da-b7f4-1754f2f38325 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:22:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:04 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Deleted allocations for instance b007f35d-b7e1-401f-8b11-37eda193e79b
Apr 11 23:22:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.597s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:04 user nova-compute[71516]: DEBUG nova.compute.manager [req-03be2c5d-f318-4d31-98aa-b92e1e76fbba req-ed612ca3-157f-45b9-bd15-3883537f25f5 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Received event network-vif-plugged-7a39b637-85b5-46da-b7f4-1754f2f38325 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:22:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-03be2c5d-f318-4d31-98aa-b92e1e76fbba req-ed612ca3-157f-45b9-bd15-3883537f25f5 service nova] Acquiring lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-03be2c5d-f318-4d31-98aa-b92e1e76fbba req-ed612ca3-157f-45b9-bd15-3883537f25f5 service nova] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-03be2c5d-f318-4d31-98aa-b92e1e76fbba req-ed612ca3-157f-45b9-bd15-3883537f25f5 service nova] Lock "b007f35d-b7e1-401f-8b11-37eda193e79b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:04 user nova-compute[71516]: DEBUG nova.compute.manager [req-03be2c5d-f318-4d31-98aa-b92e1e76fbba req-ed612ca3-157f-45b9-bd15-3883537f25f5 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] No waiting events found dispatching network-vif-plugged-7a39b637-85b5-46da-b7f4-1754f2f38325 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:22:04 user nova-compute[71516]: WARNING nova.compute.manager [req-03be2c5d-f318-4d31-98aa-b92e1e76fbba req-ed612ca3-157f-45b9-bd15-3883537f25f5 service nova] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Received unexpected event network-vif-plugged-7a39b637-85b5-46da-b7f4-1754f2f38325 for instance with vm_state deleted and task_state None.
Apr 11 23:22:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:06 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255311.6671968, bd78e8ee-ec6a-4de8-8146-bd37787b5c2c => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:22:06 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] VM Stopped (Lifecycle Event)
Apr 11 23:22:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-e890a030-92c2-4ab9-b6e2-9bdc6fcb9c21 None None] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:22:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:18 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255323.0669148, b007f35d-b7e1-401f-8b11-37eda193e79b => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:22:18 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] VM Stopped (Lifecycle Event)
Apr 11 23:22:18 user nova-compute[71516]: DEBUG nova.compute.manager [None req-69c20a11-fe2e-4729-b15a-2cb388c56947 None None] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:22:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:22:33 user nova-compute[71516]: INFO nova.compute.claims [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Claim successful on node user
Apr 11 23:22:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:22:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:22:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG nova.policy [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:22:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Creating image(s)
Apr 11 23:22:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "/opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "/opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "/opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "01d0cc9529d0406f3084ca077ccd40bbbf0a1366" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "01d0cc9529d0406f3084ca077ccd40bbbf0a1366" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366.part --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366.part --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG nova.virt.images [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] b43563e6-41a8-46f2-9c35-b9e64b84f9cf was qcow2, converting to raw {{(pid=71516) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366.part /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366.converted {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Successfully created port: 6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366.part /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366.converted" returned: 0 in 0.296s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366.converted --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366.converted --force-share --output=json" returned: 0 in 0.347s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "01d0cc9529d0406f3084ca077ccd40bbbf0a1366" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.242s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366 --force-share --output=json" returned: 0 in 0.154s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "01d0cc9529d0406f3084ca077ccd40bbbf0a1366" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "01d0cc9529d0406f3084ca077ccd40bbbf0a1366" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366 --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366,backing_fmt=raw /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366,backing_fmt=raw /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk 1073741824" returned: 0 in 0.058s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "01d0cc9529d0406f3084ca077ccd40bbbf0a1366" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366 --force-share --output=json" returned: 0 in 0.157s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Cannot resize image /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'migration_context' on Instance uuid 70323493-f9fa-49e5-a363-b34b9b8907a1 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Ensure instance console log exists: /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Successfully updated port: 6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquired lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-changed-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Refreshing instance network info cache due to event network-changed-6198de25-d537-4d39-ad81-b8af63bed69e. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] Acquiring lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updating instance_info_cache with network_info: [{"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Releasing lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Instance network_info: |[{"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] Acquired lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.network.neutron [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Refreshing network info cache for port 6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Start _get_guest_xml network_info=[{"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:22:30Z,direct_url=<?>,disk_format='qcow2',id=b43563e6-41a8-46f2-9c35-b9e64b84f9cf,min_disk=0,min_ram=0,name='tempest-scenario-img--1691484988',owner='9e8e126b69d44b27a60c421b86b79e9f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:22:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'b43563e6-41a8-46f2-9c35-b9e64b84f9cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:22:35 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:22:35 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:22:30Z,direct_url=<?>,disk_format='qcow2',id=b43563e6-41a8-46f2-9c35-b9e64b84f9cf,min_disk=0,min_ram=0,name='tempest-scenario-img--1691484988',owner='9e8e126b69d44b27a60c421b86b79e9f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:22:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:22:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-142160481',display_name='tempest-TestMinimumBasicScenario-server-142160481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-142160481',id=38,image_ref='b43563e6-41a8-46f2-9c35-b9e64b84f9cf',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQqGH/kfWyycJV+rfaP6s9LvyHbrOQOqj3ecif3osUput5uwLfhlAG3RPK68uUvF8LN/jHw+/aOHG438K/C3fo0khReoBztMDo8d2EyfaVQ8avg/fYrCuq6mMAW4+vi2g==',key_name='tempest-TestMinimumBasicScenario-838126683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e8e126b69d44b27a60c421b86b79e9f',ramdisk_id='',reservation_id='r-18dmt4r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b43563e6-41a8-46f2-9c35-b9e64b84f9cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1152745105',owner_user_name='tempest-TestMinimumBasicScenario-1152745105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:22:34Z,user_data=None,user_id='6beb3cae81a14fa2bae48a8eedcb3868',uuid=70323493-f9fa-49e5-a363-b34b9b8907a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converting VIF {"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e3:5b,bridge_name='br-int',has_traffic_filtering=True,id=6198de25-d537-4d39-ad81-b8af63bed69e,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198de25-d5') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'pci_devices' on Instance uuid 70323493-f9fa-49e5-a363-b34b9b8907a1 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:22:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:22:35 user nova-compute[71516]:   <uuid>70323493-f9fa-49e5-a363-b34b9b8907a1</uuid>
Apr 11 23:22:35 user nova-compute[71516]:   <name>instance-00000026</name>
Apr 11 23:22:35 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:22:35 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:22:35 user nova-compute[71516]:   <metadata>
Apr 11 23:22:35 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:22:35 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:22:35 user nova-compute[71516]:       <nova:name>tempest-TestMinimumBasicScenario-server-142160481</nova:name>
Apr 11 23:22:35 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:22:35</nova:creationTime>
Apr 11 23:22:35 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:22:35 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:22:35 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:22:35 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:22:35 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:22:35 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:22:35 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:22:35 user nova-compute[71516]:       <nova:owner>
Apr 11 23:22:35 user nova-compute[71516]:         <nova:user uuid="6beb3cae81a14fa2bae48a8eedcb3868">tempest-TestMinimumBasicScenario-1152745105-project-member</nova:user>
Apr 11 23:22:35 user nova-compute[71516]:         <nova:project uuid="9e8e126b69d44b27a60c421b86b79e9f">tempest-TestMinimumBasicScenario-1152745105</nova:project>
Apr 11 23:22:35 user nova-compute[71516]:       </nova:owner>
Apr 11 23:22:35 user nova-compute[71516]:       <nova:root type="image" uuid="b43563e6-41a8-46f2-9c35-b9e64b84f9cf"/>
Apr 11 23:22:35 user nova-compute[71516]:       <nova:ports>
Apr 11 23:22:35 user nova-compute[71516]:         <nova:port uuid="6198de25-d537-4d39-ad81-b8af63bed69e">
Apr 11 23:22:35 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 23:22:35 user nova-compute[71516]:         </nova:port>
Apr 11 23:22:35 user nova-compute[71516]:       </nova:ports>
Apr 11 23:22:35 user nova-compute[71516]:     </nova:instance>
Apr 11 23:22:35 user nova-compute[71516]:   </metadata>
Apr 11 23:22:35 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:22:35 user nova-compute[71516]:     <system>
Apr 11 23:22:35 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:22:35 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:22:35 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:22:35 user nova-compute[71516]:       <entry name="serial">70323493-f9fa-49e5-a363-b34b9b8907a1</entry>
Apr 11 23:22:35 user nova-compute[71516]:       <entry name="uuid">70323493-f9fa-49e5-a363-b34b9b8907a1</entry>
Apr 11 23:22:35 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:22:35 user nova-compute[71516]:     </system>
Apr 11 23:22:35 user nova-compute[71516]:   </sysinfo>
Apr 11 23:22:35 user nova-compute[71516]:   <os>
Apr 11 23:22:35 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:22:35 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:22:35 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:22:35 user nova-compute[71516]:   </os>
Apr 11 23:22:35 user nova-compute[71516]:   <features>
Apr 11 23:22:35 user nova-compute[71516]:     <acpi/>
Apr 11 23:22:35 user nova-compute[71516]:     <apic/>
Apr 11 23:22:35 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:22:35 user nova-compute[71516]:   </features>
Apr 11 23:22:35 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:22:35 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:22:35 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:22:35 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:22:35 user nova-compute[71516]:   </clock>
Apr 11 23:22:35 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:22:35 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:22:35 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:22:35 user nova-compute[71516]:   </cpu>
Apr 11 23:22:35 user nova-compute[71516]:   <devices>
Apr 11 23:22:35 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:22:35 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:22:35 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk"/>
Apr 11 23:22:35 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:22:35 user nova-compute[71516]:     </disk>
Apr 11 23:22:35 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:22:35 user nova-compute[71516]:       <mac address="fa:16:3e:3c:e3:5b"/>
Apr 11 23:22:35 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:22:35 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:22:35 user nova-compute[71516]:       <target dev="tap6198de25-d5"/>
Apr 11 23:22:35 user nova-compute[71516]:     </interface>
Apr 11 23:22:35 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:22:35 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/console.log" append="off"/>
Apr 11 23:22:35 user nova-compute[71516]:     </serial>
Apr 11 23:22:35 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:22:35 user nova-compute[71516]:     <video>
Apr 11 23:22:35 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:22:35 user nova-compute[71516]:     </video>
Apr 11 23:22:35 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:22:35 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:22:35 user nova-compute[71516]:     </rng>
Apr 11 23:22:35 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:22:35 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:22:35 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:22:35 user nova-compute[71516]:     </memballoon>
Apr 11 23:22:35 user nova-compute[71516]:   </devices>
Apr 11 23:22:35 user nova-compute[71516]: </domain>
Apr 11 23:22:35 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:22:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-142160481',display_name='tempest-TestMinimumBasicScenario-server-142160481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-142160481',id=38,image_ref='b43563e6-41a8-46f2-9c35-b9e64b84f9cf',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQqGH/kfWyycJV+rfaP6s9LvyHbrOQOqj3ecif3osUput5uwLfhlAG3RPK68uUvF8LN/jHw+/aOHG438K/C3fo0khReoBztMDo8d2EyfaVQ8avg/fYrCuq6mMAW4+vi2g==',key_name='tempest-TestMinimumBasicScenario-838126683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e8e126b69d44b27a60c421b86b79e9f',ramdisk_id='',reservation_id='r-18dmt4r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b43563e6-41a8-46f2-9c35-b9e64b84f9cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1152745105',owner_user_name='tempest-TestMinimumBasicScenario-1152745105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:22:34Z,user_data=None,user_id='6beb3cae81a14fa2bae48a8eedcb3868',uuid=70323493-f9fa-49e5-a363-b34b9b8907a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converting VIF {"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e3:5b,bridge_name='br-int',has_traffic_filtering=True,id=6198de25-d537-4d39-ad81-b8af63bed69e,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198de25-d5') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG os_vif [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e3:5b,bridge_name='br-int',has_traffic_filtering=True,id=6198de25-d537-4d39-ad81-b8af63bed69e,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198de25-d5') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6198de25-d5, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6198de25-d5, col_values=(('external_ids', {'iface-id': '6198de25-d537-4d39-ad81-b8af63bed69e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:e3:5b', 'vm-uuid': '70323493-f9fa-49e5-a363-b34b9b8907a1'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:36 user nova-compute[71516]: INFO os_vif [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e3:5b,bridge_name='br-int',has_traffic_filtering=True,id=6198de25-d537-4d39-ad81-b8af63bed69e,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198de25-d5')
Apr 11 23:22:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] No VIF found with MAC fa:16:3e:3c:e3:5b, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updated VIF entry in instance network info cache for port 6198de25-d537-4d39-ad81-b8af63bed69e. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updating instance_info_cache with network_info: [{"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:22:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] Releasing lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Skipping network cache update for instance because it is Building. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-706be35b-7b04-40e7-abdd-41f8ed417615 req-4c8e6f44-c1fa-4399-a1c5-3489daadc2a1 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-706be35b-7b04-40e7-abdd-41f8ed417615 req-4c8e6f44-c1fa-4399-a1c5-3489daadc2a1 service nova] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-706be35b-7b04-40e7-abdd-41f8ed417615 req-4c8e6f44-c1fa-4399-a1c5-3489daadc2a1 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-706be35b-7b04-40e7-abdd-41f8ed417615 req-4c8e6f44-c1fa-4399-a1c5-3489daadc2a1 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-706be35b-7b04-40e7-abdd-41f8ed417615 req-4c8e6f44-c1fa-4399-a1c5-3489daadc2a1 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] No waiting events found dispatching network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:22:37 user nova-compute[71516]: WARNING nova.compute.manager [req-706be35b-7b04-40e7-abdd-41f8ed417615 req-4c8e6f44-c1fa-4399-a1c5-3489daadc2a1 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received unexpected event network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e for instance with vm_state building and task_state spawning.
Apr 11 23:22:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:38 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Updating instance_info_cache with network_info: [{"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:22:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:22:38 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:22:38 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:22:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:38 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255359.5981655, 70323493-f9fa-49e5-a363-b34b9b8907a1 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:22:39 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] VM Resumed (Lifecycle Event)
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:22:39 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Instance spawned successfully.
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:22:39 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255359.599817, 70323493-f9fa-49e5-a363-b34b9b8907a1 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:22:39 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] VM Started (Lifecycle Event)
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:22:39 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:22:39 user nova-compute[71516]: INFO nova.compute.manager [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Took 6.18 seconds to spawn the instance on the hypervisor.
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:39 user nova-compute[71516]: INFO nova.compute.manager [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Took 6.89 seconds to build instance.
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-a267c970-3a8d-4d58-b761-127e05d7f97f req-5664b1da-5a08-4bfa-912f-81b7730bcf19 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a267c970-3a8d-4d58-b761-127e05d7f97f req-5664b1da-5a08-4bfa-912f-81b7730bcf19 service nova] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a267c970-3a8d-4d58-b761-127e05d7f97f req-5664b1da-5a08-4bfa-912f-81b7730bcf19 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a267c970-3a8d-4d58-b761-127e05d7f97f req-5664b1da-5a08-4bfa-912f-81b7730bcf19 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-a267c970-3a8d-4d58-b761-127e05d7f97f req-5664b1da-5a08-4bfa-912f-81b7730bcf19 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] No waiting events found dispatching network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:22:39 user nova-compute[71516]: WARNING nova.compute.manager [req-a267c970-3a8d-4d58-b761-127e05d7f97f req-5664b1da-5a08-4bfa-912f-81b7730bcf19 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received unexpected event network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e for instance with vm_state active and task_state None.
Apr 11 23:22:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.033s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:39 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:22:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:42 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:22:42 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:22:42 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8173MB free_disk=26.19808578491211GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance de7744d0-487a-49be-9355-fcf1266af37f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 546a073f-3860-4aea-9da5-713d87a3762e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:22:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:43 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:22:43 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:22:43 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:22:43 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:22:43 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:22:43 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:22:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:22:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:22:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:22:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:22:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:46 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:22:47 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:22:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Received event network-changed-d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:22:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Refreshing instance network info cache due to event network-changed-d998a3e0-2a86-43bd-8193-a63c4013c7c7. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:22:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] Acquiring lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:22:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] Acquired lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:22:53 user nova-compute[71516]: DEBUG nova.network.neutron [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Refreshing network info cache for port d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:22:54 user nova-compute[71516]: DEBUG nova.network.neutron [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Updated VIF entry in instance network info cache for port d998a3e0-2a86-43bd-8193-a63c4013c7c7. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:22:54 user nova-compute[71516]: DEBUG nova.network.neutron [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Updating instance_info_cache with network_info: [{"id": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "address": "fa:16:3e:e0:a2:de", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd998a3e0-2a", "ovs_interfaceid": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:22:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] Releasing lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:22:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Stashing vm_state: active {{(pid=71516) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 23:22:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received event network-changed-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:22:55 user nova-compute[71516]: DEBUG nova.compute.manager [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Refreshing instance network info cache due to event network-changed-75723ce6-e923-483c-a830-85c602bb8454. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:22:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] Acquiring lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:22:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] Acquired lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:22:55 user nova-compute[71516]: DEBUG nova.network.neutron [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Refreshing network info cache for port 75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:22:55 user nova-compute[71516]: DEBUG nova.objects.instance [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'pci_requests' on Instance uuid de7744d0-487a-49be-9355-fcf1266af37f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:22:55 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:22:55 user nova-compute[71516]: INFO nova.compute.claims [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Claim successful on node user
Apr 11 23:22:55 user nova-compute[71516]: DEBUG nova.objects.instance [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'resources' on Instance uuid de7744d0-487a-49be-9355-fcf1266af37f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:22:55 user nova-compute[71516]: DEBUG nova.objects.instance [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'pci_devices' on Instance uuid de7744d0-487a-49be-9355-fcf1266af37f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:22:55 user nova-compute[71516]: INFO nova.compute.resource_tracker [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updating resource usage from migration 63110dc6-2ba9-471e-9fc7-2a625c5a67f9
Apr 11 23:22:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:56 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:22:56 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:22:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.453s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:56 user nova-compute[71516]: INFO nova.compute.manager [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Migrating
Apr 11 23:22:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:22:56 user nova-compute[71516]: DEBUG nova.network.neutron [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updated VIF entry in instance network info cache for port 75723ce6-e923-483c-a830-85c602bb8454. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:22:56 user nova-compute[71516]: DEBUG nova.network.neutron [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updating instance_info_cache with network_info: [{"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:22:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] Releasing lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:22:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquired lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:22:56 user nova-compute[71516]: DEBUG nova.network.neutron [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:22:57 user nova-compute[71516]: DEBUG nova.network.neutron [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updating instance_info_cache with network_info: [{"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:22:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Releasing lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:22:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Starting migrate_disk_and_power_off {{(pid=71516) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 23:22:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-b375d772-569e-44bb-b837-a4126e0e5c26 req-f14a1d99-ca21-4d7a-9772-dbffe956331d service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received event network-vif-unplugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b375d772-569e-44bb-b837-a4126e0e5c26 req-f14a1d99-ca21-4d7a-9772-dbffe956331d service nova] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b375d772-569e-44bb-b837-a4126e0e5c26 req-f14a1d99-ca21-4d7a-9772-dbffe956331d service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b375d772-569e-44bb-b837-a4126e0e5c26 req-f14a1d99-ca21-4d7a-9772-dbffe956331d service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-b375d772-569e-44bb-b837-a4126e0e5c26 req-f14a1d99-ca21-4d7a-9772-dbffe956331d service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] No waiting events found dispatching network-vif-unplugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:22:58 user nova-compute[71516]: WARNING nova.compute.manager [req-b375d772-569e-44bb-b837-a4126e0e5c26 req-f14a1d99-ca21-4d7a-9772-dbffe956331d service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received unexpected event network-vif-unplugged-75723ce6-e923-483c-a830-85c602bb8454 for instance with vm_state active and task_state resize_migrating.
Apr 11 23:22:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:58 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Instance destroyed successfully.
Apr 11 23:22:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-865706147',display_name='tempest-ServerActionsTestJSON-server-865706147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-865706147',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:21:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-j4wmwff7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:22:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=de7744d0-487a-49be-9355-fcf1266af37f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:a9:87:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:a9:87:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_vif [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75723ce6-e9, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:22:58 user nova-compute[71516]: INFO os_vif [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9')
Apr 11 23:22:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLNugaoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:22:58 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdd8bd8-97a5-4a6e-a632-9853e278118e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:22:58 user nova-compute[71516]: No targets found.
Apr 11 23:22:58 user nova-compute[71516]: iSNS:
Apr 11 23:22:58 user nova-compute[71516]: No targets found.
Apr 11 23:22:58 user nova-compute[71516]: STATIC:
Apr 11 23:22:58 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35
Apr 11 23:22:58 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:22:58 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:22:58 user nova-compute[71516]: FIRMWARE:
Apr 11 23:22:58 user nova-compute[71516]: No targets found.
Apr 11 23:22:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:22:58 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:22:58 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae920bfd-1494-47ec-b728-dc8cc7d34e94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b30aef8-b035-4041-a13b-5ac0532ef319]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:22:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:22:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c716560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35'): ({'sdb'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Removing single pathed devices sdb {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cc2b25-438f-4c4a-bc8f-5c2fe3e7e267]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[41284665-6067-4acc-8df5-d6a227b85949]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flushing IO for device /dev/sdb {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cee27d-3926-4839-8100-c16f5a262850]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e280ed1-70a3-4349-b8bb-b3e6183fb227]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO25a2e0a6-913a414e2839320d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_25a2e0a6', '/dev/disk/by-id/scsi-23931336134313465') {{(pid=81691) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 23:22:58 user nova-compute[71516]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO25a2e0a6-913a414e2839320d
Apr 11 23:22:58 user nova-compute[71516]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_25a2e0a6
Apr 11 23:22:58 user nova-compute[71516]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23931336134313465
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[78138f88-8a6c-467b-9d38-83a178937c56]: (4, None) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b97b24e-5d71-4bad-9134-9ca2d436bb93]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fc368b-d79a-4fc6-b997-e13db3e5f17a]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260]
Apr 11 23:22:58 user nova-compute[71516]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260] successful.
Apr 11 23:22:58 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7941232f-919f-49e6-bf8c-b03f253452dc]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== disconnect_volume: return (333ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:22:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:22:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:22:59 user nova-compute[71516]: DEBUG nova.network.neutron [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Port 75723ce6-e923-483c-a830-85c602bb8454 binding to destination host user is already ACTIVE {{(pid=71516) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 23:23:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-ee9ed3f8-cd69-4c6f-bd08-a6380160cb71 req-eb18895c-c734-4b36-a6f2-c1a14b67dfce service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received event network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:23:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ee9ed3f8-cd69-4c6f-bd08-a6380160cb71 req-eb18895c-c734-4b36-a6f2-c1a14b67dfce service nova] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ee9ed3f8-cd69-4c6f-bd08-a6380160cb71 req-eb18895c-c734-4b36-a6f2-c1a14b67dfce service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ee9ed3f8-cd69-4c6f-bd08-a6380160cb71 req-eb18895c-c734-4b36-a6f2-c1a14b67dfce service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-ee9ed3f8-cd69-4c6f-bd08-a6380160cb71 req-eb18895c-c734-4b36-a6f2-c1a14b67dfce service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] No waiting events found dispatching network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:23:00 user nova-compute[71516]: WARNING nova.compute.manager [req-ee9ed3f8-cd69-4c6f-bd08-a6380160cb71 req-eb18895c-c734-4b36-a6f2-c1a14b67dfce service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received unexpected event network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 for instance with vm_state active and task_state resize_migrated.
Apr 11 23:23:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:23:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquired lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:23:00 user nova-compute[71516]: DEBUG nova.network.neutron [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG nova.network.neutron [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updating instance_info_cache with network_info: [{"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Releasing lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG os_brick.utils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6230f425-c812-4fc7-b419-23735396ea51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[25287b5d-d345-413e-912e-62ad9d8db2a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7540f746-a39a-4ff0-87d4-b2ffe4b52cc9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd429e03-c09b-47f5-b51a-0d67c56bbfc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:23:01 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:23:01 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af11986-0e4f-48d3-b689-1c4c17964001]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:23:01 user nova-compute[71516]: DEBUG os_brick.utils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:23:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:23:05 user nova-compute[71516]: INFO nova.compute.claims [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Claim successful on node user
Apr 11 23:23:05 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:23:05 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:23:05 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG nova.policy [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0ebfdb379f540188693c63f74c9ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af1370fd8e646d0a5066c42dff5b30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:23:05 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Creating image(s)
Apr 11 23:23:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "/opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "/opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "/opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Starting finish_migration {{(pid=71516) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Instance directory exists: not creating {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 23:23:06 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Creating image(s)
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Ensure instance console log exists: /opt/stack/data/nova/instances/de7744d0-487a-49be-9355-fcf1266af37f/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Start _get_guest_xml network_info=[{"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:a9:87:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLNugaoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'de7744d0-487a-49be-9355-fcf1266af37f', 'attached_at': '2023-04-11T23:23:06.000000', 'detached_at': '', 'volume_id': '33464ef9-378a-4982-8601-296ed0c6bd35', 'serial': '33464ef9-378a-4982-8601-296ed0c6bd35'}, 'disk_bus': 'virtio', 'attachment_id': 'cd5c88c6-8de8-44e5-82ed-01af89e46617', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:23:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:23:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.objects.instance [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'vcpu_model' on Instance uuid de7744d0-487a-49be-9355-fcf1266af37f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLNugaoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:23:06 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:23:06 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:23:06 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.154s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9897bc-3ecd-4902-8223-f02c6b497f42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:23:06 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk 1073741824" returned: 0 in 0.049s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b568e7-c8bb-431a-a57d-ca5cc3febd40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35] added
Apr 11 23:23:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b685ba0-bf1c-4634-afa9-ebd16715318e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a05bc9f-7010-4e9f-a6fe-c896577bab2c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLNugaoS {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLNugaoS" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9ae154-679c-43b8-83e8-80411a6e9985]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nLNugaoS'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03afee7-a677-4b46-af5c-9dd5ae0fa2fc]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Checking if we can resize image /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c39320e-9122-44e6-a69f-830ca68794ae]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 23:23:06 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 23:23:06 user nova-compute[71516]:  {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:23:06 user nova-compute[71516]: WARNING os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 23:23:06 user nova-compute[71516]: 
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[79185637-9e9c-460f-bd3f-cc57396c00cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260]
Apr 11 23:23:06 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260] successful.
Apr 11 23:23:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dc8d77-e0b7-40b8-8971-fd771df1e98b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Cannot resize image /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'migration_context' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[250a5f9b-8c69-4ab9-93b2-1a00ce0bf580]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:23:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:23:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Ensure instance console log exists: /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2112cddd-decb-44e0-b639-69ff58807467]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLNugaoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:23:06 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Successfully created port: 36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Successfully updated port: 36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "refresh_cache-acbc73d0-ab9c-4516-a821-a6dac6b38035" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquired lock "refresh_cache-acbc73d0-ab9c-4516-a821-a6dac6b38035" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received event network-changed-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Refreshing instance network info cache due to event network-changed-36c83f85-a0e8-4818-9f4f-490d8e14b217. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] Acquiring lock "refresh_cache-acbc73d0-ab9c-4516-a821-a6dac6b38035" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23931336134313465', 'path': '/dev/sdb'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931336134313465', 'path': '/dev/sdb'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-865706147',display_name='tempest-ServerActionsTestJSON-server-865706147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-865706147',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:21:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-j4wmwff7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=de7744d0-487a-49be-9355-fcf1266af37f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:a9:87:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:a9:87:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:23:07 user nova-compute[71516]:   <uuid>de7744d0-487a-49be-9355-fcf1266af37f</uuid>
Apr 11 23:23:07 user nova-compute[71516]:   <name>instance-00000024</name>
Apr 11 23:23:07 user nova-compute[71516]:   <memory>196608</memory>
Apr 11 23:23:07 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:23:07 user nova-compute[71516]:   <metadata>
Apr 11 23:23:07 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:23:07 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:23:07 user nova-compute[71516]:       <nova:name>tempest-ServerActionsTestJSON-server-865706147</nova:name>
Apr 11 23:23:07 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:23:06</nova:creationTime>
Apr 11 23:23:07 user nova-compute[71516]:       <nova:flavor name="m1.micro">
Apr 11 23:23:07 user nova-compute[71516]:         <nova:memory>192</nova:memory>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:23:07 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:23:07 user nova-compute[71516]:       <nova:owner>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:user uuid="ddc7eb14e7174babb8680b4020243c97">tempest-ServerActionsTestJSON-813592275-project-member</nova:user>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:project uuid="2fca37343b414de6b008ad79e022f858">tempest-ServerActionsTestJSON-813592275</nova:project>
Apr 11 23:23:07 user nova-compute[71516]:       </nova:owner>
Apr 11 23:23:07 user nova-compute[71516]:       <nova:ports>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:port uuid="75723ce6-e923-483c-a830-85c602bb8454">
Apr 11 23:23:07 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 23:23:07 user nova-compute[71516]:         </nova:port>
Apr 11 23:23:07 user nova-compute[71516]:       </nova:ports>
Apr 11 23:23:07 user nova-compute[71516]:     </nova:instance>
Apr 11 23:23:07 user nova-compute[71516]:   </metadata>
Apr 11 23:23:07 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:23:07 user nova-compute[71516]:     <system>
Apr 11 23:23:07 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:23:07 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:23:07 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:23:07 user nova-compute[71516]:       <entry name="serial">de7744d0-487a-49be-9355-fcf1266af37f</entry>
Apr 11 23:23:07 user nova-compute[71516]:       <entry name="uuid">de7744d0-487a-49be-9355-fcf1266af37f</entry>
Apr 11 23:23:07 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:23:07 user nova-compute[71516]:     </system>
Apr 11 23:23:07 user nova-compute[71516]:   </sysinfo>
Apr 11 23:23:07 user nova-compute[71516]:   <os>
Apr 11 23:23:07 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:23:07 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:23:07 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:23:07 user nova-compute[71516]:   </os>
Apr 11 23:23:07 user nova-compute[71516]:   <features>
Apr 11 23:23:07 user nova-compute[71516]:     <acpi/>
Apr 11 23:23:07 user nova-compute[71516]:     <apic/>
Apr 11 23:23:07 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:23:07 user nova-compute[71516]:   </features>
Apr 11 23:23:07 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:23:07 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:23:07 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:23:07 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:23:07 user nova-compute[71516]:   </clock>
Apr 11 23:23:07 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:23:07 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:23:07 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:23:07 user nova-compute[71516]:   </cpu>
Apr 11 23:23:07 user nova-compute[71516]:   <devices>
Apr 11 23:23:07 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:23:07 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:23:07 user nova-compute[71516]:       <source dev="/dev/sdb"/>
Apr 11 23:23:07 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:23:07 user nova-compute[71516]:       <serial>33464ef9-378a-4982-8601-296ed0c6bd35</serial>
Apr 11 23:23:07 user nova-compute[71516]:     </disk>
Apr 11 23:23:07 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:23:07 user nova-compute[71516]:       <mac address="fa:16:3e:a9:87:d4"/>
Apr 11 23:23:07 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:23:07 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:23:07 user nova-compute[71516]:       <target dev="tap75723ce6-e9"/>
Apr 11 23:23:07 user nova-compute[71516]:     </interface>
Apr 11 23:23:07 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:23:07 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/de7744d0-487a-49be-9355-fcf1266af37f/console.log" append="off"/>
Apr 11 23:23:07 user nova-compute[71516]:     </serial>
Apr 11 23:23:07 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:23:07 user nova-compute[71516]:     <video>
Apr 11 23:23:07 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:23:07 user nova-compute[71516]:     </video>
Apr 11 23:23:07 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:23:07 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:23:07 user nova-compute[71516]:     </rng>
Apr 11 23:23:07 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:23:07 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:23:07 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:23:07 user nova-compute[71516]:     </memballoon>
Apr 11 23:23:07 user nova-compute[71516]:   </devices>
Apr 11 23:23:07 user nova-compute[71516]: </domain>
Apr 11 23:23:07 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-865706147',display_name='tempest-ServerActionsTestJSON-server-865706147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-865706147',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:21:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-j4wmwff7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=de7744d0-487a-49be-9355-fcf1266af37f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:a9:87:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-501245624-network", "vif_mac": "fa:16:3e:a9:87:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG os_vif [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75723ce6-e9, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75723ce6-e9, col_values=(('external_ids', {'iface-id': '75723ce6-e923-483c-a830-85c602bb8454', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:87:d4', 'vm-uuid': 'de7744d0-487a-49be-9355-fcf1266af37f'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:07 user nova-compute[71516]: INFO os_vif [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9')
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] No VIF found with MAC fa:16:3e:a9:87:d4, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.network.neutron [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Updating instance_info_cache with network_info: [{"id": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "address": "fa:16:3e:bc:4f:55", "network": {"id": "76b0a0b7-401f-44e6-ace6-bac4e29c0ec4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1458706670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af1370fd8e646d0a5066c42dff5b30f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c83f85-a0", "ovs_interfaceid": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Releasing lock "refresh_cache-acbc73d0-ab9c-4516-a821-a6dac6b38035" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Instance network_info: |[{"id": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "address": "fa:16:3e:bc:4f:55", "network": {"id": "76b0a0b7-401f-44e6-ace6-bac4e29c0ec4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1458706670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af1370fd8e646d0a5066c42dff5b30f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c83f85-a0", "ovs_interfaceid": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] Acquired lock "refresh_cache-acbc73d0-ab9c-4516-a821-a6dac6b38035" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.network.neutron [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Refreshing network info cache for port 36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Start _get_guest_xml network_info=[{"id": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "address": "fa:16:3e:bc:4f:55", "network": {"id": "76b0a0b7-401f-44e6-ace6-bac4e29c0ec4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1458706670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af1370fd8e646d0a5066c42dff5b30f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c83f85-a0", "ovs_interfaceid": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:23:07 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:23:07 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1711417485',display_name='tempest-SnapshotDataIntegrityTests-server-1711417485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1711417485',id=39,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUWUtLbTKq+AUj8Uy8O9tvOBWgBrtL+o/73ozA9TTO3DvBRE/6oeST9X/TTWUygilmTDxs/k1hBTXhyEfya0gLgVki/2ncujtXGZV/qXtTHa0+XA4KdKMeiJChGGgeDMQ==',key_name='tempest-SnapshotDataIntegrityTests-1460777543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2af1370fd8e646d0a5066c42dff5b30f',ramdisk_id='',reservation_id='r-bcmdt8pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1086939592',owner_user_name='tempest-SnapshotDataIntegrityTests-1086939592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:23:06Z,user_data=None,user_id='e0ebfdb379f540188693c63f74c9ad68',uuid=acbc73d0-ab9c-4516-a821-a6dac6b38035,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "address": "fa:16:3e:bc:4f:55", "network": {"id": "76b0a0b7-401f-44e6-ace6-bac4e29c0ec4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1458706670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af1370fd8e646d0a5066c42dff5b30f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c83f85-a0", "ovs_interfaceid": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Converting VIF {"id": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "address": "fa:16:3e:bc:4f:55", "network": {"id": "76b0a0b7-401f-44e6-ace6-bac4e29c0ec4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1458706670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af1370fd8e646d0a5066c42dff5b30f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c83f85-a0", "ovs_interfaceid": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:4f:55,bridge_name='br-int',has_traffic_filtering=True,id=36c83f85-a0e8-4818-9f4f-490d8e14b217,network=Network(76b0a0b7-401f-44e6-ace6-bac4e29c0ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c83f85-a0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'pci_devices' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:23:07 user nova-compute[71516]:   <uuid>acbc73d0-ab9c-4516-a821-a6dac6b38035</uuid>
Apr 11 23:23:07 user nova-compute[71516]:   <name>instance-00000027</name>
Apr 11 23:23:07 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:23:07 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:23:07 user nova-compute[71516]:   <metadata>
Apr 11 23:23:07 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:23:07 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:23:07 user nova-compute[71516]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1711417485</nova:name>
Apr 11 23:23:07 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:23:07</nova:creationTime>
Apr 11 23:23:07 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:23:07 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:23:07 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:23:07 user nova-compute[71516]:       <nova:owner>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:user uuid="e0ebfdb379f540188693c63f74c9ad68">tempest-SnapshotDataIntegrityTests-1086939592-project-member</nova:user>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:project uuid="2af1370fd8e646d0a5066c42dff5b30f">tempest-SnapshotDataIntegrityTests-1086939592</nova:project>
Apr 11 23:23:07 user nova-compute[71516]:       </nova:owner>
Apr 11 23:23:07 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:23:07 user nova-compute[71516]:       <nova:ports>
Apr 11 23:23:07 user nova-compute[71516]:         <nova:port uuid="36c83f85-a0e8-4818-9f4f-490d8e14b217">
Apr 11 23:23:07 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 23:23:07 user nova-compute[71516]:         </nova:port>
Apr 11 23:23:07 user nova-compute[71516]:       </nova:ports>
Apr 11 23:23:07 user nova-compute[71516]:     </nova:instance>
Apr 11 23:23:07 user nova-compute[71516]:   </metadata>
Apr 11 23:23:07 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:23:07 user nova-compute[71516]:     <system>
Apr 11 23:23:07 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:23:07 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:23:07 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:23:07 user nova-compute[71516]:       <entry name="serial">acbc73d0-ab9c-4516-a821-a6dac6b38035</entry>
Apr 11 23:23:07 user nova-compute[71516]:       <entry name="uuid">acbc73d0-ab9c-4516-a821-a6dac6b38035</entry>
Apr 11 23:23:07 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:23:07 user nova-compute[71516]:     </system>
Apr 11 23:23:07 user nova-compute[71516]:   </sysinfo>
Apr 11 23:23:07 user nova-compute[71516]:   <os>
Apr 11 23:23:07 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:23:07 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:23:07 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:23:07 user nova-compute[71516]:   </os>
Apr 11 23:23:07 user nova-compute[71516]:   <features>
Apr 11 23:23:07 user nova-compute[71516]:     <acpi/>
Apr 11 23:23:07 user nova-compute[71516]:     <apic/>
Apr 11 23:23:07 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:23:07 user nova-compute[71516]:   </features>
Apr 11 23:23:07 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:23:07 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:23:07 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:23:07 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:23:07 user nova-compute[71516]:   </clock>
Apr 11 23:23:07 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:23:07 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:23:07 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:23:07 user nova-compute[71516]:   </cpu>
Apr 11 23:23:07 user nova-compute[71516]:   <devices>
Apr 11 23:23:07 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:23:07 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:23:07 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk"/>
Apr 11 23:23:07 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:23:07 user nova-compute[71516]:     </disk>
Apr 11 23:23:07 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:23:07 user nova-compute[71516]:       <mac address="fa:16:3e:bc:4f:55"/>
Apr 11 23:23:07 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:23:07 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:23:07 user nova-compute[71516]:       <target dev="tap36c83f85-a0"/>
Apr 11 23:23:07 user nova-compute[71516]:     </interface>
Apr 11 23:23:07 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:23:07 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/console.log" append="off"/>
Apr 11 23:23:07 user nova-compute[71516]:     </serial>
Apr 11 23:23:07 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:23:07 user nova-compute[71516]:     <video>
Apr 11 23:23:07 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:23:07 user nova-compute[71516]:     </video>
Apr 11 23:23:07 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:23:07 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:23:07 user nova-compute[71516]:     </rng>
Apr 11 23:23:07 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:23:07 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:23:07 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:23:07 user nova-compute[71516]:     </memballoon>
Apr 11 23:23:07 user nova-compute[71516]:   </devices>
Apr 11 23:23:07 user nova-compute[71516]: </domain>
Apr 11 23:23:07 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1711417485',display_name='tempest-SnapshotDataIntegrityTests-server-1711417485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1711417485',id=39,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUWUtLbTKq+AUj8Uy8O9tvOBWgBrtL+o/73ozA9TTO3DvBRE/6oeST9X/TTWUygilmTDxs/k1hBTXhyEfya0gLgVki/2ncujtXGZV/qXtTHa0+XA4KdKMeiJChGGgeDMQ==',key_name='tempest-SnapshotDataIntegrityTests-1460777543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2af1370fd8e646d0a5066c42dff5b30f',ramdisk_id='',reservation_id='r-bcmdt8pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1086939592',owner_user_name='tempest-SnapshotDataIntegrityTests-1086939592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:23:06Z,user_data=None,user_id='e0ebfdb379f540188693c63f74c9ad68',uuid=acbc73d0-ab9c-4516-a821-a6dac6b38035,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "address": "fa:16:3e:bc:4f:55", "network": {"id": "76b0a0b7-401f-44e6-ace6-bac4e29c0ec4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1458706670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af1370fd8e646d0a5066c42dff5b30f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c83f85-a0", "ovs_interfaceid": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Converting VIF {"id": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "address": "fa:16:3e:bc:4f:55", "network": {"id": "76b0a0b7-401f-44e6-ace6-bac4e29c0ec4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1458706670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af1370fd8e646d0a5066c42dff5b30f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c83f85-a0", "ovs_interfaceid": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:4f:55,bridge_name='br-int',has_traffic_filtering=True,id=36c83f85-a0e8-4818-9f4f-490d8e14b217,network=Network(76b0a0b7-401f-44e6-ace6-bac4e29c0ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c83f85-a0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG os_vif [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:4f:55,bridge_name='br-int',has_traffic_filtering=True,id=36c83f85-a0e8-4818-9f4f-490d8e14b217,network=Network(76b0a0b7-401f-44e6-ace6-bac4e29c0ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c83f85-a0') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36c83f85-a0, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36c83f85-a0, col_values=(('external_ids', {'iface-id': '36c83f85-a0e8-4818-9f4f-490d8e14b217', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:4f:55', 'vm-uuid': 'acbc73d0-ab9c-4516-a821-a6dac6b38035'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:07 user nova-compute[71516]: INFO os_vif [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:4f:55,bridge_name='br-int',has_traffic_filtering=True,id=36c83f85-a0e8-4818-9f4f-490d8e14b217,network=Network(76b0a0b7-401f-44e6-ace6-bac4e29c0ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c83f85-a0')
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:23:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No VIF found with MAC fa:16:3e:bc:4f:55, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:23:08 user nova-compute[71516]: DEBUG nova.network.neutron [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Updated VIF entry in instance network info cache for port 36c83f85-a0e8-4818-9f4f-490d8e14b217. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:23:08 user nova-compute[71516]: DEBUG nova.network.neutron [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Updating instance_info_cache with network_info: [{"id": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "address": "fa:16:3e:bc:4f:55", "network": {"id": "76b0a0b7-401f-44e6-ace6-bac4e29c0ec4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1458706670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af1370fd8e646d0a5066c42dff5b30f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c83f85-a0", "ovs_interfaceid": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:23:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] Releasing lock "refresh_cache-acbc73d0-ab9c-4516-a821-a6dac6b38035" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:23:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-b8aefc33-4582-4531-875f-730770e3b488 req-ed2e0733-c5e9-4105-b771-fa04056a4064 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received event network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b8aefc33-4582-4531-875f-730770e3b488 req-ed2e0733-c5e9-4105-b771-fa04056a4064 service nova] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b8aefc33-4582-4531-875f-730770e3b488 req-ed2e0733-c5e9-4105-b771-fa04056a4064 service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b8aefc33-4582-4531-875f-730770e3b488 req-ed2e0733-c5e9-4105-b771-fa04056a4064 service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-b8aefc33-4582-4531-875f-730770e3b488 req-ed2e0733-c5e9-4105-b771-fa04056a4064 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] No waiting events found dispatching network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:23:10 user nova-compute[71516]: WARNING nova.compute.manager [req-b8aefc33-4582-4531-875f-730770e3b488 req-ed2e0733-c5e9-4105-b771-fa04056a4064 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received unexpected event network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 for instance with vm_state active and task_state resize_finish.
Apr 11 23:23:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-d07198e8-b7d4-4641-b5ef-bed2770d5240 req-7c23578d-08ac-4eea-9d1c-77e929b56f45 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received event network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d07198e8-b7d4-4641-b5ef-bed2770d5240 req-7c23578d-08ac-4eea-9d1c-77e929b56f45 service nova] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d07198e8-b7d4-4641-b5ef-bed2770d5240 req-7c23578d-08ac-4eea-9d1c-77e929b56f45 service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d07198e8-b7d4-4641-b5ef-bed2770d5240 req-7c23578d-08ac-4eea-9d1c-77e929b56f45 service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-d07198e8-b7d4-4641-b5ef-bed2770d5240 req-7c23578d-08ac-4eea-9d1c-77e929b56f45 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] No waiting events found dispatching network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:23:10 user nova-compute[71516]: WARNING nova.compute.manager [req-d07198e8-b7d4-4641-b5ef-bed2770d5240 req-7c23578d-08ac-4eea-9d1c-77e929b56f45 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received unexpected event network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance with vm_state building and task_state spawning.
Apr 11 23:23:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG nova.compute.manager [req-0046bffd-1fc6-4f7b-8aea-6f87189435e3 req-2ab8c510-c026-42a1-9962-10bc0484f200 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received event network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0046bffd-1fc6-4f7b-8aea-6f87189435e3 req-2ab8c510-c026-42a1-9962-10bc0484f200 service nova] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0046bffd-1fc6-4f7b-8aea-6f87189435e3 req-2ab8c510-c026-42a1-9962-10bc0484f200 service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0046bffd-1fc6-4f7b-8aea-6f87189435e3 req-2ab8c510-c026-42a1-9962-10bc0484f200 service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG nova.compute.manager [req-0046bffd-1fc6-4f7b-8aea-6f87189435e3 req-2ab8c510-c026-42a1-9962-10bc0484f200 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] No waiting events found dispatching network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:23:12 user nova-compute[71516]: WARNING nova.compute.manager [req-0046bffd-1fc6-4f7b-8aea-6f87189435e3 req-2ab8c510-c026-42a1-9962-10bc0484f200 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received unexpected event network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 for instance with vm_state active and task_state resize_finish.
Apr 11 23:23:12 user nova-compute[71516]: DEBUG nova.compute.manager [req-324d521f-8d40-4b62-98b1-3fe3f55fb415 req-f2742c67-4f47-41d4-9a1c-185739d3b2de service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received event network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-324d521f-8d40-4b62-98b1-3fe3f55fb415 req-f2742c67-4f47-41d4-9a1c-185739d3b2de service nova] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-324d521f-8d40-4b62-98b1-3fe3f55fb415 req-f2742c67-4f47-41d4-9a1c-185739d3b2de service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-324d521f-8d40-4b62-98b1-3fe3f55fb415 req-f2742c67-4f47-41d4-9a1c-185739d3b2de service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG nova.compute.manager [req-324d521f-8d40-4b62-98b1-3fe3f55fb415 req-f2742c67-4f47-41d4-9a1c-185739d3b2de service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] No waiting events found dispatching network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:23:12 user nova-compute[71516]: WARNING nova.compute.manager [req-324d521f-8d40-4b62-98b1-3fe3f55fb415 req-f2742c67-4f47-41d4-9a1c-185739d3b2de service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received unexpected event network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance with vm_state building and task_state spawning.
Apr 11 23:23:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for de7744d0-487a-49be-9355-fcf1266af37f due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255392.963618, de7744d0-487a-49be-9355-fcf1266af37f => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:23:12 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] VM Resumed (Lifecycle Event)
Apr 11 23:23:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:23:12 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Instance spawned successfully.
Apr 11 23:23:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:23:12 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Instance running successfully.
Apr 11 23:23:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Failed to set time: agent not configured {{(pid=71516) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 23:23:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] finish_migration finished successfully. {{(pid=71516) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:23:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255392.9688475, de7744d0-487a-49be-9355-fcf1266af37f => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:23:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] VM Started (Lifecycle Event)
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:23:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255392.968977, acbc73d0-ab9c-4516-a821-a6dac6b38035 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:23:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] VM Resumed (Lifecycle Event)
Apr 11 23:23:13 user nova-compute[71516]: INFO nova.compute.manager [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Took 7.25 seconds to spawn the instance on the hypervisor.
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:23:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255392.9704995, acbc73d0-ab9c-4516-a821-a6dac6b38035 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:23:13 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] VM Started (Lifecycle Event)
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:23:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:23:13 user nova-compute[71516]: INFO nova.compute.manager [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Took 8.03 seconds to build instance.
Apr 11 23:23:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.155s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-changed-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:23:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Refreshing instance network info cache due to event network-changed-76adadaa-820a-4fa5-b837-6ef514aa0b8f. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:23:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] Acquiring lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:23:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] Acquired lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:23:22 user nova-compute[71516]: DEBUG nova.network.neutron [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Refreshing network info cache for port 76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:23:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "546a073f-3860-4aea-9da5-713d87a3762e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:22 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'flavor' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:23:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "546a073f-3860-4aea-9da5-713d87a3762e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "546a073f-3860-4aea-9da5-713d87a3762e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:23 user nova-compute[71516]: INFO nova.compute.manager [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Attaching volume 3c77b710-e771-4ae0-a61f-30aea1088f14 to /dev/vdb
Apr 11 23:23:23 user nova-compute[71516]: DEBUG os_brick.utils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb4d6a2-8902-4778-a2eb-fee63ea80151]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bcef3c-d692-4c61-b169-24a9ac657a2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d409530f-dc62-4a71-a98c-7f5e6ddf1488]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0a2aa7-4a30-4fe0-a557-0f940e011a76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:23:23 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8aa007-027f-4b51-96fe-896b77547785]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG os_brick.utils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updating existing volume attachment record: 0394000f-c0ec-44e2-8e09-dff5b1bb6f06 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG nova.network.neutron [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updated VIF entry in instance network info cache for port 76adadaa-820a-4fa5-b837-6ef514aa0b8f. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG nova.network.neutron [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updating instance_info_cache with network_info: [{"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:23:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] Releasing lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:23:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGljTCNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:23:28 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:23:28 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:23:28 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceaa103-f8f5-4fd3-afb9-bf845dd44f02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:23:28 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d64d4e-1b84-4c5a-8987-b674b5945940]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14] added
Apr 11 23:23:28 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdae2caa-fcda-4a40-ace6-e5d6a0e9188f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[79645218-925d-4a67-be99-6bdf6ef9b290]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGljTCNh {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGljTCNh" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a900f3-8615-4a65-8ab4-9d846ca79148]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LGljTCNh'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb35c55-2a60-453c-bbab-03f6506f1f43]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[605adbd0-61e5-4cf4-af58-9ffa7b3f39a8]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:23:28 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:23:28 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7e29ed-e6de-40c7-8d03-0a48ba585e5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14, portal: 172.16.0.220,3260]
Apr 11 23:23:28 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14, portal: 172.16.0.220,3260] successful.
Apr 11 23:23:28 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb60bcd-06fa-4050-a898-a53b4d1c57cf]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[031a7569-fae7-4fc9-bb85-e7200a15e103]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:23:28 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:23:28 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:23:28 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:23:28 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[265cf18f-eba3-404c-8a1a-e198de1f5406]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:23:28 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGljTCNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:23:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:23:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26161346162626365', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:23:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161346162626365', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:23:29 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'flavor' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:23:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:23:29 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:23:29 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:23:29 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:23:29 user nova-compute[71516]:   <serial>3c77b710-e771-4ae0-a61f-30aea1088f14</serial>
Apr 11 23:23:29 user nova-compute[71516]: </disk>
Apr 11 23:23:29 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:23:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:23:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:23:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No VIF found with MAC fa:16:3e:7a:74:8a, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:23:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "546a073f-3860-4aea-9da5-713d87a3762e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.745s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:31 user nova-compute[71516]: INFO nova.compute.manager [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Rescuing
Apr 11 23:23:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:23:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquired lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:23:31 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:23:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:31 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updating instance_info_cache with network_info: [{"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:23:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Releasing lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:23:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:31 user nova-compute[71516]: DEBUG nova.compute.manager [req-6f2137bd-e980-493e-b4ba-3839e3fad797 req-118475cd-e2fc-4c44-9c5c-d9e6e9462aa9 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-unplugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:23:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6f2137bd-e980-493e-b4ba-3839e3fad797 req-118475cd-e2fc-4c44-9c5c-d9e6e9462aa9 service nova] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6f2137bd-e980-493e-b4ba-3839e3fad797 req-118475cd-e2fc-4c44-9c5c-d9e6e9462aa9 service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6f2137bd-e980-493e-b4ba-3839e3fad797 req-118475cd-e2fc-4c44-9c5c-d9e6e9462aa9 service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:31 user nova-compute[71516]: DEBUG nova.compute.manager [req-6f2137bd-e980-493e-b4ba-3839e3fad797 req-118475cd-e2fc-4c44-9c5c-d9e6e9462aa9 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] No waiting events found dispatching network-vif-unplugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:23:31 user nova-compute[71516]: WARNING nova.compute.manager [req-6f2137bd-e980-493e-b4ba-3839e3fad797 req-118475cd-e2fc-4c44-9c5c-d9e6e9462aa9 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received unexpected event network-vif-unplugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance with vm_state active and task_state rescuing.
Apr 11 23:23:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:32 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Instance destroyed successfully.
Apr 11 23:23:32 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Attempting rescue
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71516) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Instance directory exists: not creating {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 23:23:32 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Creating image(s)
Apr 11 23:23:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "/opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "/opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "/opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'trusted_certs' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.rescue {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.rescue" returned: 0 in 0.053s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'migration_context' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Start _get_guest_xml network_info=[{"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "vif_mac": "fa:16:3e:7a:74:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'resources' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'numa_topology' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:23:32 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:23:32 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'vcpu_model' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1543973671',display_name='tempest-ServerRescueNegativeTestJSON-server-1543973671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1543973671',id=37,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrGcGiE4e6Tp38+exR5YT3oDXkSl1ZsauX2FXZ9tTkUu/HLi16m9tlHlzQu5NVP1uorNPN1lADTpqYHlQH1A6/c0JnTeih3uliLzgAEFHnvGzYHnPpZKyFHC5IeclDOHA==',key_name='tempest-keypair-1207488062',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:21:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31c373270f804948a04c8125848fa181',ramdisk_id='',reservation_id='r-6681j8m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-242021724',owner_user_name='tempest-ServerRescueNegativeTestJSON-242021724-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d63779eda794ef0b2413ac1483f88b8',uuid=546a073f-3860-4aea-9da5-713d87a3762e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "vif_mac": "fa:16:3e:7a:74:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converting VIF {"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "vif_mac": "fa:16:3e:7a:74:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=76adadaa-820a-4fa5-b837-6ef514aa0b8f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adadaa-82') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'pci_devices' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:23:32 user nova-compute[71516]:   <uuid>546a073f-3860-4aea-9da5-713d87a3762e</uuid>
Apr 11 23:23:32 user nova-compute[71516]:   <name>instance-00000025</name>
Apr 11 23:23:32 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:23:32 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:23:32 user nova-compute[71516]:   <metadata>
Apr 11 23:23:32 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:23:32 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:23:32 user nova-compute[71516]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1543973671</nova:name>
Apr 11 23:23:32 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:23:32</nova:creationTime>
Apr 11 23:23:32 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:23:32 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:23:32 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:23:32 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:23:32 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:23:32 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:23:32 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:23:32 user nova-compute[71516]:       <nova:owner>
Apr 11 23:23:32 user nova-compute[71516]:         <nova:user uuid="8d63779eda794ef0b2413ac1483f88b8">tempest-ServerRescueNegativeTestJSON-242021724-project-member</nova:user>
Apr 11 23:23:32 user nova-compute[71516]:         <nova:project uuid="31c373270f804948a04c8125848fa181">tempest-ServerRescueNegativeTestJSON-242021724</nova:project>
Apr 11 23:23:32 user nova-compute[71516]:       </nova:owner>
Apr 11 23:23:32 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:23:32 user nova-compute[71516]:       <nova:ports>
Apr 11 23:23:32 user nova-compute[71516]:         <nova:port uuid="76adadaa-820a-4fa5-b837-6ef514aa0b8f">
Apr 11 23:23:32 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 23:23:32 user nova-compute[71516]:         </nova:port>
Apr 11 23:23:32 user nova-compute[71516]:       </nova:ports>
Apr 11 23:23:32 user nova-compute[71516]:     </nova:instance>
Apr 11 23:23:32 user nova-compute[71516]:   </metadata>
Apr 11 23:23:32 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:23:32 user nova-compute[71516]:     <system>
Apr 11 23:23:32 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:23:32 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:23:32 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:23:32 user nova-compute[71516]:       <entry name="serial">546a073f-3860-4aea-9da5-713d87a3762e</entry>
Apr 11 23:23:32 user nova-compute[71516]:       <entry name="uuid">546a073f-3860-4aea-9da5-713d87a3762e</entry>
Apr 11 23:23:32 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:23:32 user nova-compute[71516]:     </system>
Apr 11 23:23:32 user nova-compute[71516]:   </sysinfo>
Apr 11 23:23:32 user nova-compute[71516]:   <os>
Apr 11 23:23:32 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:23:32 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:23:32 user nova-compute[71516]:   </os>
Apr 11 23:23:32 user nova-compute[71516]:   <features>
Apr 11 23:23:32 user nova-compute[71516]:     <acpi/>
Apr 11 23:23:32 user nova-compute[71516]:     <apic/>
Apr 11 23:23:32 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:23:32 user nova-compute[71516]:   </features>
Apr 11 23:23:32 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:23:32 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:23:32 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:23:32 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:23:32 user nova-compute[71516]:   </clock>
Apr 11 23:23:32 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:23:32 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:23:32 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:23:32 user nova-compute[71516]:   </cpu>
Apr 11 23:23:32 user nova-compute[71516]:   <devices>
Apr 11 23:23:32 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:23:32 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:23:32 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.rescue"/>
Apr 11 23:23:32 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:23:32 user nova-compute[71516]:     </disk>
Apr 11 23:23:32 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:23:32 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:23:32 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk"/>
Apr 11 23:23:32 user nova-compute[71516]:       <target dev="vdb" bus="virtio"/>
Apr 11 23:23:32 user nova-compute[71516]:     </disk>
Apr 11 23:23:32 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:23:32 user nova-compute[71516]:       <mac address="fa:16:3e:7a:74:8a"/>
Apr 11 23:23:32 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:23:32 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:23:32 user nova-compute[71516]:       <target dev="tap76adadaa-82"/>
Apr 11 23:23:32 user nova-compute[71516]:     </interface>
Apr 11 23:23:32 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:23:32 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/console.log" append="off"/>
Apr 11 23:23:32 user nova-compute[71516]:     </serial>
Apr 11 23:23:32 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:23:32 user nova-compute[71516]:     <video>
Apr 11 23:23:32 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:23:32 user nova-compute[71516]:     </video>
Apr 11 23:23:32 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:23:32 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:23:32 user nova-compute[71516]:     </rng>
Apr 11 23:23:32 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:23:32 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:23:32 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:23:32 user nova-compute[71516]:     </memballoon>
Apr 11 23:23:32 user nova-compute[71516]:   </devices>
Apr 11 23:23:32 user nova-compute[71516]: </domain>
Apr 11 23:23:32 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:23:32 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Instance destroyed successfully.
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] No VIF found with MAC fa:16:3e:7a:74:8a, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:23:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:33 user nova-compute[71516]: DEBUG nova.compute.manager [req-177fe378-bdc9-419d-a193-02cff8ad9b31 req-c4f1df00-ca3d-4dfb-be4d-b2820d2a9931 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:23:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-177fe378-bdc9-419d-a193-02cff8ad9b31 req-c4f1df00-ca3d-4dfb-be4d-b2820d2a9931 service nova] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-177fe378-bdc9-419d-a193-02cff8ad9b31 req-c4f1df00-ca3d-4dfb-be4d-b2820d2a9931 service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-177fe378-bdc9-419d-a193-02cff8ad9b31 req-c4f1df00-ca3d-4dfb-be4d-b2820d2a9931 service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:33 user nova-compute[71516]: DEBUG nova.compute.manager [req-177fe378-bdc9-419d-a193-02cff8ad9b31 req-c4f1df00-ca3d-4dfb-be4d-b2820d2a9931 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] No waiting events found dispatching network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:23:33 user nova-compute[71516]: WARNING nova.compute.manager [req-177fe378-bdc9-419d-a193-02cff8ad9b31 req-c4f1df00-ca3d-4dfb-be4d-b2820d2a9931 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received unexpected event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance with vm_state active and task_state rescuing.
Apr 11 23:23:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:35 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:23:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:23:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] No waiting events found dispatching network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:23:35 user nova-compute[71516]: WARNING nova.compute.manager [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received unexpected event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance with vm_state active and task_state rescuing.
Apr 11 23:23:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:23:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] No waiting events found dispatching network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:23:35 user nova-compute[71516]: WARNING nova.compute.manager [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received unexpected event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance with vm_state active and task_state rescuing.
Apr 11 23:23:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for 546a073f-3860-4aea-9da5-713d87a3762e due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:23:36 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255416.463313, 546a073f-3860-4aea-9da5-713d87a3762e => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:23:36 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] VM Resumed (Lifecycle Event)
Apr 11 23:23:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:23:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:23:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:23:36 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 23:23:36 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255416.464449, 546a073f-3860-4aea-9da5-713d87a3762e => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:23:36 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] VM Started (Lifecycle Event)
Apr 11 23:23:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:23:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:23:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:39 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:23:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:23:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:23:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:23:39 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:23:39 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Updating instance_info_cache with network_info: [{"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:23:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:23:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:23:39 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:23:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:39 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:23:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:40 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:23:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:23:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:23:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:43 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:23:43 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8009MB free_disk=26.124134063720703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Applying migration context for instance de7744d0-487a-49be-9355-fcf1266af37f as it has an incoming, in-progress migration 63110dc6-2ba9-471e-9fc7-2a625c5a67f9. Migration status is finished {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 23:23:43 user nova-compute[71516]: INFO nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updating resource usage from migration 63110dc6-2ba9-471e-9fc7-2a625c5a67f9
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 546a073f-3860-4aea-9da5-713d87a3762e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Migration 63110dc6-2ba9-471e-9fc7-2a625c5a67f9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance de7744d0-487a-49be-9355-fcf1266af37f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance acbc73d0-ab9c-4516-a821-a6dac6b38035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:23:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:23:44 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:23:44 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:23:44 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:23:44 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:23:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:23:47 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:23:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:23:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:23:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:23:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:23:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:49 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:23:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:23:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:24:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:24:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:24:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:24:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:24:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:24:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:24:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:24:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG nova.objects.instance [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'flavor' on Instance uuid 70323493-f9fa-49e5-a363-b34b9b8907a1 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:24:25 user nova-compute[71516]: INFO nova.compute.manager [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Attaching volume 78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf to /dev/vdb
Apr 11 23:24:25 user nova-compute[71516]: DEBUG os_brick.utils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b14826-a1e4-45ab-9767-bd14a3903106]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[19955b6a-e187-4977-a8f4-13f316c28a8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed107416-bf55-4994-a717-fa8fb96739c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3552a0a8-507c-4d35-a578-7d3e446be80d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:24:25 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:24:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c57060-8dfe-41e2-bb49-eb859c1f08ca]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG os_brick.utils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:24:25 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updating existing volume attachment record: c47b9383-ef0e-47c1-9191-4bee4e52cdda {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:24:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snwtEkZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:24:29 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:24:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:24:29 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:24:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:24:29 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcbc772-0436-4e59-89fd-16aef2a06c2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:24:29 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04209ed-ad04-4fb3-a8ec-d4ead7ab3a47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf] added
Apr 11 23:24:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.054s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d2eee0-a3f8-47c5-a02f-b9d34b930da2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[45932ce2-2c80-4fa3-ab0c-826d05004b21]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snwtEkZx {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snwtEkZx" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c139e0-3d7f-4362-943f-39f80db096ad]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'snwtEkZx'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8302c966-89bc-4dd2-9a24-4b68a97bf433]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c035cf-f873-4114-a7d4-0c79e0a64c20]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:24:29 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:24:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:24:30 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:24:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21f5695-023d-4234-a279-9a3c28183e26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf, portal: 172.16.0.220,3260]
Apr 11 23:24:30 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf, portal: 172.16.0.220,3260] successful.
Apr 11 23:24:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e4df8b-07d2-4933-834d-78fbf9c3c7ba]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea392262-7689-4175-bf75-0048454e2631]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:24:30 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:24:30 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:24:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:24:30 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:24:30 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:24:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce2cdda-b389-42f8-9845-942c1d7ff6f9]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: None {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:24:31 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:24:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snwtEkZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:24:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:24:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23766306161633739', 'path': '/dev/sdd'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:24:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766306161633739', 'path': '/dev/sdd'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:24:31 user nova-compute[71516]: DEBUG nova.objects.instance [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'flavor' on Instance uuid 70323493-f9fa-49e5-a363-b34b9b8907a1 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:24:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:24:31 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:24:31 user nova-compute[71516]:   <source dev="/dev/sdd"/>
Apr 11 23:24:31 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:24:31 user nova-compute[71516]:   <serial>78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf</serial>
Apr 11 23:24:31 user nova-compute[71516]: </disk>
Apr 11 23:24:31 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:24:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:24:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:24:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] No VIF found with MAC fa:16:3e:3c:e3:5b, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:24:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.122s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:24:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:24:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:24:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:24:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:24:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:33 user nova-compute[71516]: DEBUG nova.compute.manager [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-changed-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:24:33 user nova-compute[71516]: DEBUG nova.compute.manager [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Refreshing instance network info cache due to event network-changed-6198de25-d537-4d39-ad81-b8af63bed69e. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:24:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] Acquiring lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:24:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] Acquired lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:24:33 user nova-compute[71516]: DEBUG nova.network.neutron [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Refreshing network info cache for port 6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:24:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:34 user nova-compute[71516]: DEBUG nova.network.neutron [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updated VIF entry in instance network info cache for port 6198de25-d537-4d39-ad81-b8af63bed69e. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:24:34 user nova-compute[71516]: DEBUG nova.network.neutron [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updating instance_info_cache with network_info: [{"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:24:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] Releasing lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-changed-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Refreshing instance network info cache due to event network-changed-6198de25-d537-4d39-ad81-b8af63bed69e. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] Acquiring lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] Acquired lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Refreshing network info cache for port 6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:24:36 user nova-compute[71516]: INFO nova.compute.manager [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Rebooting instance
Apr 11 23:24:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updated VIF entry in instance network info cache for port 6198de25-d537-4d39-ad81-b8af63bed69e. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updating instance_info_cache with network_info: [{"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] Releasing lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquired lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:24:36 user nova-compute[71516]: DEBUG nova.network.neutron [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:24:37 user nova-compute[71516]: DEBUG nova.network.neutron [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updating instance_info_cache with network_info: [{"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:24:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Releasing lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:24:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:24:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-25a9e270-3a92-43ad-bf60-f0d9254a45ff req-3ae9b40a-d217-41c2-b590-f46fdbe95981 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-vif-unplugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:24:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25a9e270-3a92-43ad-bf60-f0d9254a45ff req-3ae9b40a-d217-41c2-b590-f46fdbe95981 service nova] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:24:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25a9e270-3a92-43ad-bf60-f0d9254a45ff req-3ae9b40a-d217-41c2-b590-f46fdbe95981 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:24:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25a9e270-3a92-43ad-bf60-f0d9254a45ff req-3ae9b40a-d217-41c2-b590-f46fdbe95981 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:24:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-25a9e270-3a92-43ad-bf60-f0d9254a45ff req-3ae9b40a-d217-41c2-b590-f46fdbe95981 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] No waiting events found dispatching network-vif-unplugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:24:39 user nova-compute[71516]: WARNING nova.compute.manager [req-25a9e270-3a92-43ad-bf60-f0d9254a45ff req-3ae9b40a-d217-41c2-b590-f46fdbe95981 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received unexpected event network-vif-unplugged-6198de25-d537-4d39-ad81-b8af63bed69e for instance with vm_state active and task_state reboot_started.
Apr 11 23:24:40 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:24:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:24:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:24:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:24:40 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:24:40 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Instance shutdown successfully.
Apr 11 23:24:40 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Updating instance_info_cache with network_info: [{"id": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "address": "fa:16:3e:e0:a2:de", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd998a3e0-2a", "ovs_interfaceid": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:24:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-e8b26dd1-48ce-476d-99e8-60001f2d7528" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:24:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:24:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:41 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:24:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:24:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:24:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:24:41 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:24:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] No waiting events found dispatching network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:24:42 user nova-compute[71516]: WARNING nova.compute.manager [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received unexpected event network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e for instance with vm_state active and task_state reboot_started.
Apr 11 23:24:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] No waiting events found dispatching network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:24:42 user nova-compute[71516]: WARNING nova.compute.manager [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received unexpected event network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e for instance with vm_state active and task_state reboot_started.
Apr 11 23:24:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG nova.compute.manager [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] No waiting events found dispatching network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:24:42 user nova-compute[71516]: WARNING nova.compute.manager [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received unexpected event network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e for instance with vm_state active and task_state reboot_started.
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:42 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for 70323493-f9fa-49e5-a363-b34b9b8907a1 due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255483.6332834, 70323493-f9fa-49e5-a363-b34b9b8907a1 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:24:43 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] VM Resumed (Lifecycle Event)
Apr 11 23:24:43 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Instance running successfully.
Apr 11 23:24:43 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Instance soft rebooted successfully.
Apr 11 23:24:43 user nova-compute[71516]: DEBUG nova.compute.manager [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:24:43 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 11 23:24:43 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255483.637762, 70323493-f9fa-49e5-a363-b34b9b8907a1 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:24:43 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] VM Started (Lifecycle Event)
Apr 11 23:24:43 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.631s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.rescue --force-share --output=json" returned: 0 in 0.127s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:24:44 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:24:44 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8192MB free_disk=26.094669342041016GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Applying migration context for instance de7744d0-487a-49be-9355-fcf1266af37f as it has an incoming, in-progress migration 63110dc6-2ba9-471e-9fc7-2a625c5a67f9. Migration status is finished {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 23:24:44 user nova-compute[71516]: INFO nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updating resource usage from migration 63110dc6-2ba9-471e-9fc7-2a625c5a67f9
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 546a073f-3860-4aea-9da5-713d87a3762e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Migration 63110dc6-2ba9-471e-9fc7-2a625c5a67f9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance de7744d0-487a-49be-9355-fcf1266af37f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance acbc73d0-ab9c-4516-a821-a6dac6b38035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:24:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "de7744d0-487a-49be-9355-fcf1266af37f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Going to confirm migration 2 {{(pid=71516) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquired lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'info_cache' on Instance uuid de7744d0-487a-49be-9355-fcf1266af37f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG nova.network.neutron [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updating instance_info_cache with network_info: [{"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Releasing lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'migration_context' on Instance uuid de7744d0-487a-49be-9355-fcf1266af37f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:24:45 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:24:46 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:24:46 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:24:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.334s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:24:46 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:24:46 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Deleted allocation for migration 63110dc6-2ba9-471e-9fc7-2a625c5a67f9
Apr 11 23:24:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "de7744d0-487a-49be-9355-fcf1266af37f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.271s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:24:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:48 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:24:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:51 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:24:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:24:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received event network-changed-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:24:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Refreshing instance network info cache due to event network-changed-36c83f85-a0e8-4818-9f4f-490d8e14b217. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:24:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] Acquiring lock "refresh_cache-acbc73d0-ab9c-4516-a821-a6dac6b38035" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:24:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] Acquired lock "refresh_cache-acbc73d0-ab9c-4516-a821-a6dac6b38035" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:24:58 user nova-compute[71516]: DEBUG nova.network.neutron [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Refreshing network info cache for port 36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:24:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:24:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:24:58 user nova-compute[71516]: DEBUG nova.objects.instance [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'flavor' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:24:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:24:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:24:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:24:58 user nova-compute[71516]: INFO nova.compute.manager [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Attaching volume 60b99c36-512f-42e1-a9f6-a59e284daf4c to /dev/vdb
Apr 11 23:24:59 user nova-compute[71516]: DEBUG os_brick.utils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG nova.network.neutron [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Updated VIF entry in instance network info cache for port 36c83f85-a0e8-4818-9f4f-490d8e14b217. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG nova.network.neutron [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Updating instance_info_cache with network_info: [{"id": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "address": "fa:16:3e:bc:4f:55", "network": {"id": "76b0a0b7-401f-44e6-ace6-bac4e29c0ec4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1458706670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af1370fd8e646d0a5066c42dff5b30f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c83f85-a0", "ovs_interfaceid": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[be38205a-5a39-41e1-b97f-8f00e66dd19a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] Releasing lock "refresh_cache-acbc73d0-ab9c-4516-a821-a6dac6b38035" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[549f7f0d-c71b-4f02-a013-4a382e874f0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c9d242-52d2-46b9-be8d-8cb3c8d7d601]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f390567c-1aab-4f70-9243-3aae065f433d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:24:59 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:24:59 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10ada76-11fd-45f1-80b4-8a3b9d208a4d]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG os_brick.utils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:24:59 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Updating existing volume attachment record: 054bf443-c93c-4873-b3f3-f1e89de338cb {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:25:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbOqhEwi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:25:03 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:25:03 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:25:03 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e6938-e1fc-47bd-9812-1f12200c27eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:25:03 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d661da2f-100b-4535-b069-c4a6dba21124]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c] added
Apr 11 23:25:03 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf19c42-1591-4948-8c13-564ada44b2e5]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0f3e4c-4311-4209-a8e9-8469996c9575]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbOqhEwi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbOqhEwi" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6c48dc-4368-445f-a87a-e5dbe608541a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kbOqhEwi'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a821b03e-a544-40cc-8574-d922ec62159e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[133487fb-584f-4a02-bbcd-6865b0f5d7ca]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:25:03 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:25:03 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:25:03 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:25:03 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:25:03 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:25:03 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c118870b-17c1-4054-932f-b261ab8ad90a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c, portal: 172.16.0.220,3260]
Apr 11 23:25:03 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c, portal: 172.16.0.220,3260] successful.
Apr 11 23:25:03 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f6f856-a9a5-499d-b52b-5639b912b62d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bded6e-66e8-4edd-99d7-642073ae5bc7]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:25:03 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:25:03 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:25:03 user nova-compute[71516]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c (non-flash)
Apr 11 23:25:03 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:25:03 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:25:03 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:25:03 user nova-compute[71516]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c (non-flash)
Apr 11 23:25:03 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c73d244-84bc-4e48-8ff4-2c5fadb258c8]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:03 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:25:04 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:25:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbOqhEwi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:25:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:25:04 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26361383937356233', 'path': '/dev/sde'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:25:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361383937356233', 'path': '/dev/sde'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:25:04 user nova-compute[71516]: DEBUG nova.objects.instance [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'flavor' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:25:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:25:04 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:25:04 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:25:04 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:25:04 user nova-compute[71516]:   <serial>60b99c36-512f-42e1-a9f6-a59e284daf4c</serial>
Apr 11 23:25:04 user nova-compute[71516]: </disk>
Apr 11 23:25:04 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:25:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:25:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:25:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No VIF found with MAC fa:16:3e:bc:4f:55, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:25:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.194s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:25:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:25:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:25:10 user nova-compute[71516]: INFO nova.compute.manager [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Detaching volume 60b99c36-512f-42e1-a9f6-a59e284daf4c
Apr 11 23:25:10 user nova-compute[71516]: INFO nova.virt.block_device [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Attempting to driver detach volume 60b99c36-512f-42e1-a9f6-a59e284daf4c from mountpoint /dev/vdb
Apr 11 23:25:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Attempting to detach device vdb from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:25:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:25:10 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:25:10 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:25:10 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:25:10 user nova-compute[71516]:   <serial>60b99c36-512f-42e1-a9f6-a59e284daf4c</serial>
Apr 11 23:25:10 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:25:10 user nova-compute[71516]: </disk>
Apr 11 23:25:10 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:25:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Successfully detached device vdb from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the persistent domain config.
Apr 11 23:25:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:25:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:25:10 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:25:10 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:25:10 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:25:10 user nova-compute[71516]:   <serial>60b99c36-512f-42e1-a9f6-a59e284daf4c</serial>
Apr 11 23:25:10 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:25:10 user nova-compute[71516]: </disk>
Apr 11 23:25:10 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681255511.2660737, acbc73d0-ab9c-4516-a821-a6dac6b38035 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:25:11 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Successfully detached device vdb from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the live domain config.
Apr 11 23:25:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbOqhEwi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:25:11 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c367f8-9f0e-4702-be56-435fbf5bf231]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:25:11 user nova-compute[71516]: No targets found.
Apr 11 23:25:11 user nova-compute[71516]: iSNS:
Apr 11 23:25:11 user nova-compute[71516]: No targets found.
Apr 11 23:25:11 user nova-compute[71516]: STATIC:
Apr 11 23:25:11 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35
Apr 11 23:25:11 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:25:11 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:25:11 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf
Apr 11 23:25:11 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:25:11 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:25:11 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c
Apr 11 23:25:11 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:25:11 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:25:11 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14
Apr 11 23:25:11 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:25:11 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:25:11 user nova-compute[71516]: FIRMWARE:
Apr 11 23:25:11 user nova-compute[71516]: No targets found.
Apr 11 23:25:11 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:25:11 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:25:11 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6af475d-a0c2-42f2-b12f-af22526480a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8943070-e1ea-484d-9548-940c4624d53c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:25:11 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:25:11 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:25:11 user nova-compute[71516]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c (non-flash)
Apr 11 23:25:11 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:25:11 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:25:11 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:25:11 user nova-compute[71516]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c (non-flash)
Apr 11 23:25:11 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c187e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c'): ({'sde'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Removing single pathed devices sde {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d514755-4a73-4b61-b311-ce7bac33d208]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0cc47c-5c4a-448f-94fd-df4b172e8a22]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Flushing IO for device /dev/sde {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[427c0de2-c822-4047-ad7b-08d6595e8ab7]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[779e0d70-8fcf-492f-bc68-e0acc511dd9b]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6043c0dc-ce44-4d14-a6cc-d3002190fc4a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[597a3c51-edf4-4e88-8387-9f1bf9d696b1]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c, portal: 172.16.0.220,3260]
Apr 11 23:25:11 user nova-compute[71516]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c, portal: 172.16.0.220,3260] successful.
Apr 11 23:25:11 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b99c36-512f-42e1-a9f6-a59e284daf4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4417318a-65ef-4ae5-a850-5728b0bf17bf]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] <== disconnect_volume: return (307ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:25:11 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:25:12 user nova-compute[71516]: DEBUG nova.objects.instance [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'flavor' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:25:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.610s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:25:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:22 user nova-compute[71516]: INFO nova.compute.manager [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Unrescuing
Apr 11 23:25:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:25:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquired lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:25:22 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:25:22 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updating instance_info_cache with network_info: [{"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:25:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Releasing lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:25:22 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'flavor' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:25:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-fede98c8-cd50-4452-af7d-cd44299ea94b req-38342dd5-e38c-4e20-a685-cb9b5f19ed63 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-unplugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:25:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-fede98c8-cd50-4452-af7d-cd44299ea94b req-38342dd5-e38c-4e20-a685-cb9b5f19ed63 service nova] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:25:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-fede98c8-cd50-4452-af7d-cd44299ea94b req-38342dd5-e38c-4e20-a685-cb9b5f19ed63 service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:25:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-fede98c8-cd50-4452-af7d-cd44299ea94b req-38342dd5-e38c-4e20-a685-cb9b5f19ed63 service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:25:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-fede98c8-cd50-4452-af7d-cd44299ea94b req-38342dd5-e38c-4e20-a685-cb9b5f19ed63 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] No waiting events found dispatching network-vif-unplugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:25:22 user nova-compute[71516]: WARNING nova.compute.manager [req-fede98c8-cd50-4452-af7d-cd44299ea94b req-38342dd5-e38c-4e20-a685-cb9b5f19ed63 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received unexpected event network-vif-unplugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:25:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:23 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Instance destroyed successfully.
Apr 11 23:25:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-cc11c456-ae39-44b0-b04f-7e858a19b2db req-15ba96f7-76f5-4a39-8844-f9be1643134b service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:25:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cc11c456-ae39-44b0-b04f-7e858a19b2db req-15ba96f7-76f5-4a39-8844-f9be1643134b service nova] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:25:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cc11c456-ae39-44b0-b04f-7e858a19b2db req-15ba96f7-76f5-4a39-8844-f9be1643134b service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:25:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cc11c456-ae39-44b0-b04f-7e858a19b2db req-15ba96f7-76f5-4a39-8844-f9be1643134b service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:25:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-cc11c456-ae39-44b0-b04f-7e858a19b2db req-15ba96f7-76f5-4a39-8844-f9be1643134b service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] No waiting events found dispatching network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:25:24 user nova-compute[71516]: WARNING nova.compute.manager [req-cc11c456-ae39-44b0-b04f-7e858a19b2db req-15ba96f7-76f5-4a39-8844-f9be1643134b service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received unexpected event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:25:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for 546a073f-3860-4aea-9da5-713d87a3762e due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:25:26 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255526.8581324, 546a073f-3860-4aea-9da5-713d87a3762e => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:25:26 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] VM Resumed (Lifecycle Event)
Apr 11 23:25:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:25:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:25:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:25:26 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 23:25:26 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255526.8602161, 546a073f-3860-4aea-9da5-713d87a3762e => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:25:26 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] VM Started (Lifecycle Event)
Apr 11 23:25:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:25:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:25:27 user nova-compute[71516]: DEBUG nova.compute.manager [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:25:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:25:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:25:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:25:27 user nova-compute[71516]: DEBUG nova.compute.manager [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] No waiting events found dispatching network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:25:27 user nova-compute[71516]: WARNING nova.compute.manager [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received unexpected event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance with vm_state active and task_state None.
Apr 11 23:25:27 user nova-compute[71516]: DEBUG nova.compute.manager [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:25:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:25:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:25:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:25:27 user nova-compute[71516]: DEBUG nova.compute.manager [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] No waiting events found dispatching network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:25:27 user nova-compute[71516]: WARNING nova.compute.manager [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received unexpected event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance with vm_state active and task_state None.
Apr 11 23:25:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:29 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:25:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 23:25:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] There are 0 instances to clean {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 23:25:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:37 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:25:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:25:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:25:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:25:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:25:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:42 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:25:42 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:25:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:25:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:25:42 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:25:42 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updating instance_info_cache with network_info: [{"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:25:42 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-de7744d0-487a-49be-9355-fcf1266af37f" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:25:42 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:25:42 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:43 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:44 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:25:45 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:25:45 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:25:45 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8167MB free_disk=26.11056137084961GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 546a073f-3860-4aea-9da5-713d87a3762e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance de7744d0-487a-49be-9355-fcf1266af37f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance acbc73d0-ab9c-4516-a821-a6dac6b38035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:25:45 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:25:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:46 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:25:46 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:25:46 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:25:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:25:47 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:25:47 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:25:47 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:25:47 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:25:47 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances with incomplete migration  {{(pid=71516) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 23:25:47 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:25:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:48 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:25:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:25:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:25:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:25:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:25:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:25:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:25:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:53 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:25:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:25:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:26:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:26:02 user nova-compute[71516]: DEBUG nova.objects.instance [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'flavor' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:26:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:26:03 user nova-compute[71516]: INFO nova.compute.manager [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Attaching volume a841378f-78ee-4221-810f-51e451ff84ac to /dev/vdb
Apr 11 23:26:03 user nova-compute[71516]: DEBUG os_brick.utils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7211de41-dfaf-45b5-aa3b-61a14d4e2338]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c029194-a4e5-45bc-bc40-6307a1f599f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01e5572-0e2f-4f92-bae5-4652232c3b08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[783fc24a-481e-4904-b61e-49d9681338da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:26:03 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:26:03 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad58fe2f-b41d-466c-98b0-f34e46a16a0c]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG os_brick.utils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:26:03 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Updating existing volume attachment record: 1678f20c-9064-4907-bbe6-b9f58d4e86cf {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:26:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sedjnaRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:26:07 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:26:07 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:26:07 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2a706a-7c39-4dd5-9a38-8d737c952c91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:26:07 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d9a08d-6a8d-4fa2-abed-038260f1a739]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac] added
Apr 11 23:26:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0714989-3172-4cb0-842e-0dee1c35081b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5952f43e-9809-4fdd-aea7-69ae57a80075]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sedjnaRk {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sedjnaRk" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cf95e2-c58a-48a0-98e2-fda455f7ca10]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sedjnaRk'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bd3d47-f6b7-4395-9960-e220ba2e10d4]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0319b87b-cd18-45ab-b40a-7ef8720b9660]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:26:07 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:26:07 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:26:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:26:07 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:26:07 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:26:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa51e6f-810b-4a47-8a72-57f5420117ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac, portal: 172.16.0.220,3260]
Apr 11 23:26:07 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac, portal: 172.16.0.220,3260] successful.
Apr 11 23:26:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a54d7f-06b8-486a-bbaa-4c8a92c212b6]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9598cc6e-0724-404c-aced-2cd7b8771310]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:26:07 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:26:07 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:26:07 user nova-compute[71516]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac (non-flash)
Apr 11 23:26:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:26:07 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:26:07 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:26:07 user nova-compute[71516]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac (non-flash)
Apr 11 23:26:07 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b04ad73-b792-4fec-91cc-2115d69e3743]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:26:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sedjnaRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:26:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:26:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26562663939313535', 'path': '/dev/sde'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:26:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562663939313535', 'path': '/dev/sde'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:26:08 user nova-compute[71516]: DEBUG nova.objects.instance [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'flavor' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:26:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:26:08 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:26:08 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:26:08 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:26:08 user nova-compute[71516]:   <serial>a841378f-78ee-4221-810f-51e451ff84ac</serial>
Apr 11 23:26:08 user nova-compute[71516]: </disk>
Apr 11 23:26:08 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:26:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:26:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:26:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No VIF found with MAC fa:16:3e:bc:4f:55, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:26:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.105s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:26:10 user nova-compute[71516]: INFO nova.compute.manager [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Detaching volume a841378f-78ee-4221-810f-51e451ff84ac
Apr 11 23:26:10 user nova-compute[71516]: INFO nova.virt.block_device [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Attempting to driver detach volume a841378f-78ee-4221-810f-51e451ff84ac from mountpoint /dev/vdb
Apr 11 23:26:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Attempting to detach device vdb from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:26:10 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:26:10 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:26:10 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:26:10 user nova-compute[71516]:   <serial>a841378f-78ee-4221-810f-51e451ff84ac</serial>
Apr 11 23:26:10 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:26:10 user nova-compute[71516]: </disk>
Apr 11 23:26:10 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:26:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Successfully detached device vdb from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the persistent domain config.
Apr 11 23:26:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:26:10 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:26:10 user nova-compute[71516]:   <source dev="/dev/sde"/>
Apr 11 23:26:10 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:26:10 user nova-compute[71516]:   <serial>a841378f-78ee-4221-810f-51e451ff84ac</serial>
Apr 11 23:26:10 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:26:10 user nova-compute[71516]: </disk>
Apr 11 23:26:10 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681255570.5800002, acbc73d0-ab9c-4516-a821-a6dac6b38035 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:26:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Successfully detached device vdb from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the live domain config.
Apr 11 23:26:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sedjnaRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:26:10 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b500e0d-e9fe-404a-9872-e31abc195366]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:26:10 user nova-compute[71516]: No targets found.
Apr 11 23:26:10 user nova-compute[71516]: iSNS:
Apr 11 23:26:10 user nova-compute[71516]: No targets found.
Apr 11 23:26:10 user nova-compute[71516]: STATIC:
Apr 11 23:26:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35
Apr 11 23:26:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:26:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:26:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf
Apr 11 23:26:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:26:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:26:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14
Apr 11 23:26:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:26:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:26:10 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac
Apr 11 23:26:10 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:26:10 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:26:10 user nova-compute[71516]: FIRMWARE:
Apr 11 23:26:10 user nova-compute[71516]: No targets found.
Apr 11 23:26:10 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:26:10 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:26:10 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d17a2be-b63a-4806-a345-fd6028908dbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d402969a-6a34-42c2-95a0-00e6e7c1b366]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:26:10 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:26:10 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:26:10 user nova-compute[71516]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac (non-flash)
Apr 11 23:26:10 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:26:10 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:26:10 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:26:10 user nova-compute[71516]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac (non-flash)
Apr 11 23:26:10 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c4ea440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac'): ({'sde'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Removing single pathed devices sde {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e5371c-4f75-4cac-8c12-6308ad726cf0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ca72bc-f0a0-478c-b16e-05c79713d0fa]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Flushing IO for device /dev/sde {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff800a3c-24e3-4a79-857e-0cb9670e0bad]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56eec45-2325-475d-9acf-d50412ae142f]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] SCSI volumes sde have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abf2245-ddee-4fe4-ba2c-807ef9d904fe]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5e3a6e-458d-4625-ac50-5bad237dbe4b]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac, portal: 172.16.0.220,3260]
Apr 11 23:26:10 user nova-compute[71516]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac, portal: 172.16.0.220,3260] successful.
Apr 11 23:26:10 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a841378f-78ee-4221-810f-51e451ff84ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3f4fe9-77e9-4cca-af0c-7909289e5787]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] <== disconnect_volume: return (306ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:26:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:26:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:11 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'flavor' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:26:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.636s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:26:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:26:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:26:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:26:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:26:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:27 user nova-compute[71516]: DEBUG nova.compute.manager [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-changed-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:26:27 user nova-compute[71516]: DEBUG nova.compute.manager [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Refreshing instance network info cache due to event network-changed-6198de25-d537-4d39-ad81-b8af63bed69e. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:26:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] Acquiring lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:26:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] Acquired lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:26:27 user nova-compute[71516]: DEBUG nova.network.neutron [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Refreshing network info cache for port 6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:26:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:28 user nova-compute[71516]: DEBUG nova.network.neutron [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updated VIF entry in instance network info cache for port 6198de25-d537-4d39-ad81-b8af63bed69e. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:26:28 user nova-compute[71516]: DEBUG nova.network.neutron [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updating instance_info_cache with network_info: [{"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:26:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] Releasing lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:26:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-changed-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:26:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Refreshing instance network info cache due to event network-changed-6198de25-d537-4d39-ad81-b8af63bed69e. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:26:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] Acquiring lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:26:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] Acquired lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:26:28 user nova-compute[71516]: DEBUG nova.network.neutron [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Refreshing network info cache for port 6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:26:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:26:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:26:28 user nova-compute[71516]: INFO nova.compute.manager [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Detaching volume 78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf
Apr 11 23:26:28 user nova-compute[71516]: INFO nova.virt.block_device [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Attempting to driver detach volume 78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf from mountpoint /dev/vdb
Apr 11 23:26:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Attempting to detach device vdb from instance 70323493-f9fa-49e5-a363-b34b9b8907a1 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:26:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:26:28 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:26:28 user nova-compute[71516]:   <source dev="/dev/sdd"/>
Apr 11 23:26:28 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:26:28 user nova-compute[71516]:   <serial>78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf</serial>
Apr 11 23:26:28 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:26:28 user nova-compute[71516]: </disk>
Apr 11 23:26:28 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:26:28 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Successfully detached device vdb from instance 70323493-f9fa-49e5-a363-b34b9b8907a1 from the persistent domain config.
Apr 11 23:26:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 70323493-f9fa-49e5-a363-b34b9b8907a1 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:26:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:26:28 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:26:28 user nova-compute[71516]:   <source dev="/dev/sdd"/>
Apr 11 23:26:28 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:26:28 user nova-compute[71516]:   <serial>78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf</serial>
Apr 11 23:26:28 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:26:28 user nova-compute[71516]: </disk>
Apr 11 23:26:28 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG nova.network.neutron [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updated VIF entry in instance network info cache for port 6198de25-d537-4d39-ad81-b8af63bed69e. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG nova.network.neutron [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updating instance_info_cache with network_info: [{"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] Releasing lock "refresh_cache-70323493-f9fa-49e5-a363-b34b9b8907a1" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681255589.3045144, 70323493-f9fa-49e5-a363-b34b9b8907a1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:26:29 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Successfully detached device vdb from instance 70323493-f9fa-49e5-a363-b34b9b8907a1 from the live domain config.
Apr 11 23:26:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snwtEkZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:26:29 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad607a6-a733-4a45-ab5f-f208fede78e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:26:29 user nova-compute[71516]: No targets found.
Apr 11 23:26:29 user nova-compute[71516]: iSNS:
Apr 11 23:26:29 user nova-compute[71516]: No targets found.
Apr 11 23:26:29 user nova-compute[71516]: STATIC:
Apr 11 23:26:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35
Apr 11 23:26:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:26:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:26:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf
Apr 11 23:26:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:26:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:26:29 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14
Apr 11 23:26:29 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:26:29 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:26:29 user nova-compute[71516]: FIRMWARE:
Apr 11 23:26:29 user nova-compute[71516]: No targets found.
Apr 11 23:26:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:26:29 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:26:29 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf2cd0f-c6f3-4b50-8f32-98791d35a682]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a50725-6c47-4976-8a1d-35d4e551c138]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:26:29 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:26:29 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:26:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:26:29 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:26:29 user nova-compute[71516]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf (non-flash)
Apr 11 23:26:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c143880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf'): ({'sdd'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Removing single pathed devices sdd {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da33017-f848-4df9-aab7-9012a31349bf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97cee12-3bad-4ca0-a44e-f0f207a7fe5d]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Flushing IO for device /dev/sdd {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[923410b7-d4b5-4394-b457-53d7e9b769c9]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce0c7d0-f7f3-4656-a727-166d0284613b]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6009adf3-c362-42c4-9c5c-3a03acecc316]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b040ca3-6cf7-4a5b-828f-9fc1ecb6b471]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf, portal: 172.16.0.220,3260]
Apr 11 23:26:29 user nova-compute[71516]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf, portal: 172.16.0.220,3260] successful.
Apr 11 23:26:29 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d933bfd5-4eee-446e-ac21-0a087437da63]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] <== disconnect_volume: return (289ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:26:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:26:30 user nova-compute[71516]: DEBUG nova.objects.instance [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'flavor' on Instance uuid 70323493-f9fa-49e5-a363-b34b9b8907a1 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:26:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.629s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:26:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:36 user nova-compute[71516]: INFO nova.compute.manager [None req-0f7246d4-bc4c-4334-b80d-4f2b42108635 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Get console output
Apr 11 23:26:36 user nova-compute[71516]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 11 23:26:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:26:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:26:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:26:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:26:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:39 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:26:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:44 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:26:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:26:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:26:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:26:44 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:26:44 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updating instance_info_cache with network_info: [{"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:26:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:26:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:26:44 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:45 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:26:47 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:26:47 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8237MB free_disk=26.109214782714844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 546a073f-3860-4aea-9da5-713d87a3762e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance de7744d0-487a-49be-9355-fcf1266af37f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance acbc73d0-ab9c-4516-a821-a6dac6b38035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing inventories for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating ProviderTree inventory for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating inventory in ProviderTree for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 23:26:47 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing aggregate associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, aggregates: None {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 23:26:48 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing trait associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 23:26:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:48 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:26:48 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:26:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:26:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:26:49 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:26:49 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:26:49 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:26:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:26:51 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:26:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:26:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:26:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:26:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:26:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:26:55 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:26:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:01 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'flavor' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:27:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:02 user nova-compute[71516]: INFO nova.compute.manager [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Attaching volume 876f4485-cc3f-4c6e-b387-563ec9619806 to /dev/vdb
Apr 11 23:27:02 user nova-compute[71516]: DEBUG os_brick.utils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3513cf-f3df-4651-afb5-6215f510d323]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dcad93-e77c-4af8-b051-c362dd933248]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2166b99d-1c70-4ba0-b6e8-e95173684557]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbdd7c1-47b6-4bfa-9569-c3bff9bd1510]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:27:02 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:27:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa267f84-28d9-466f-a9d3-290621355692]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG os_brick.utils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:27:02 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Updating existing volume attachment record: 777b8e61-0d52-441b-b4ca-64df0c88e5e0 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:27:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtFzsjyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:27:06 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:27:06 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:27:06 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99e3af4-4e80-41a6-8e28-ae744aaeb520]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:27:06 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a32a71d-309b-4cd9-b09e-e9edebd9da6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806] added
Apr 11 23:27:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8070109-80dd-4896-aedb-a6ba69405936]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baa96f7-a991-4180-a081-4b73af417578]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CtFzsjyl {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CtFzsjyl" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed8bd6f-2834-4d8b-a257-3825d286c8f5]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CtFzsjyl'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eb4543-a268-4de5-bd3e-8f368ecc5c8c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[563165c4-6746-4b4a-ad18-5203f2090072]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:27:06 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:27:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:27:06 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:27:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6343dd76-0feb-46fe-b696-9ee4916ce1f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806, portal: 172.16.0.220,3260]
Apr 11 23:27:06 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806, portal: 172.16.0.220,3260] successful.
Apr 11 23:27:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd8cb10-18e5-4a2c-9cea-e20c4654c7e2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6172b879-5dc8-43f7-a642-c779e1ceedd0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:27:06 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:27:06 user nova-compute[71516]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 (non-flash)
Apr 11 23:27:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:27:06 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:27:06 user nova-compute[71516]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 (non-flash)
Apr 11 23:27:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eb12a0-238f-42c4-b39a-201e3bba7413]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:27:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtFzsjyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:27:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:27:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23365333230303263', 'path': '/dev/sdd'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:27:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365333230303263', 'path': '/dev/sdd'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:27:07 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'flavor' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:27:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:27:07 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:27:07 user nova-compute[71516]:   <source dev="/dev/sdd"/>
Apr 11 23:27:07 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:27:07 user nova-compute[71516]:   <serial>876f4485-cc3f-4c6e-b387-563ec9619806</serial>
Apr 11 23:27:07 user nova-compute[71516]: </disk>
Apr 11 23:27:07 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:27:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:27:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:27:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No VIF found with MAC fa:16:3e:bc:4f:55, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:27:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.355s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:09 user nova-compute[71516]: INFO nova.compute.manager [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Detaching volume 876f4485-cc3f-4c6e-b387-563ec9619806
Apr 11 23:27:09 user nova-compute[71516]: INFO nova.virt.block_device [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Attempting to driver detach volume 876f4485-cc3f-4c6e-b387-563ec9619806 from mountpoint /dev/vdb
Apr 11 23:27:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Attempting to detach device vdb from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:27:09 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:27:09 user nova-compute[71516]:   <source dev="/dev/sdd"/>
Apr 11 23:27:09 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:27:09 user nova-compute[71516]:   <serial>876f4485-cc3f-4c6e-b387-563ec9619806</serial>
Apr 11 23:27:09 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:27:09 user nova-compute[71516]: </disk>
Apr 11 23:27:09 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:27:09 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Successfully detached device vdb from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the persistent domain config.
Apr 11 23:27:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:27:09 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:27:09 user nova-compute[71516]:   <source dev="/dev/sdd"/>
Apr 11 23:27:09 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:27:09 user nova-compute[71516]:   <serial>876f4485-cc3f-4c6e-b387-563ec9619806</serial>
Apr 11 23:27:09 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:27:09 user nova-compute[71516]: </disk>
Apr 11 23:27:09 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681255629.5815103, acbc73d0-ab9c-4516-a821-a6dac6b38035 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:27:09 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Successfully detached device vdb from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the live domain config.
Apr 11 23:27:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CtFzsjyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:27:09 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[146d04d2-4fc7-4db3-bd25-c666ce5249d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:27:09 user nova-compute[71516]: No targets found.
Apr 11 23:27:09 user nova-compute[71516]: iSNS:
Apr 11 23:27:09 user nova-compute[71516]: No targets found.
Apr 11 23:27:09 user nova-compute[71516]: STATIC:
Apr 11 23:27:09 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35
Apr 11 23:27:09 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:27:09 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:27:09 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806
Apr 11 23:27:09 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:27:09 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:27:09 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14
Apr 11 23:27:09 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:27:09 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:27:09 user nova-compute[71516]: FIRMWARE:
Apr 11 23:27:09 user nova-compute[71516]: No targets found.
Apr 11 23:27:09 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:27:09 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:27:09 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6b620a-d473-426f-8106-5c492155c95f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c456bb52-be77-4e67-8a74-8dfed2e6f7b5]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:27:09 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:27:09 user nova-compute[71516]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 (non-flash)
Apr 11 23:27:09 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:27:09 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:27:09 user nova-compute[71516]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 (non-flash)
Apr 11 23:27:09 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c438160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806'): ({'sdd'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Removing single pathed devices sdd {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[436d7e05-1cfe-4f4e-b6ca-8d035a09f46e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2818cf25-53e3-49fe-8ea8-64f150b83e3c]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Flushing IO for device /dev/sdd {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e726c2df-ae20-491f-a514-352a43aaf3e2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d44be9-9dc2-4078-8944-6c6af6df6f66]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] SCSI volumes sdd have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0a02a8-edd1-4c84-bf47-70f71b50f016]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a6aa4c-7a04-4cbe-a293-9d8b5cc418c4]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806, portal: 172.16.0.220,3260]
Apr 11 23:27:09 user nova-compute[71516]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806, portal: 172.16.0.220,3260] successful.
Apr 11 23:27:09 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:876f4485-cc3f-4c6e-b387-563ec9619806 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ba5a46-1122-4ec4-8647-6eacb861411a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] <== disconnect_volume: return (275ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:27:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:27:10 user nova-compute[71516]: DEBUG nova.objects.instance [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'flavor' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:27:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.599s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-changed-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:27:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Refreshing instance network info cache due to event network-changed-76adadaa-820a-4fa5-b837-6ef514aa0b8f. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:27:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] Acquiring lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:27:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] Acquired lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:27:13 user nova-compute[71516]: DEBUG nova.network.neutron [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Refreshing network info cache for port 76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "546a073f-3860-4aea-9da5-713d87a3762e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:14 user nova-compute[71516]: INFO nova.compute.manager [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Detaching volume 3c77b710-e771-4ae0-a61f-30aea1088f14
Apr 11 23:27:14 user nova-compute[71516]: INFO nova.virt.block_device [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Attempting to driver detach volume 3c77b710-e771-4ae0-a61f-30aea1088f14 from mountpoint /dev/vdb
Apr 11 23:27:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Attempting to detach device vdb from instance 546a073f-3860-4aea-9da5-713d87a3762e from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:27:14 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:27:14 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:27:14 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:27:14 user nova-compute[71516]:   <serial>3c77b710-e771-4ae0-a61f-30aea1088f14</serial>
Apr 11 23:27:14 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:27:14 user nova-compute[71516]: </disk>
Apr 11 23:27:14 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:27:14 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Successfully detached device vdb from instance 546a073f-3860-4aea-9da5-713d87a3762e from the persistent domain config.
Apr 11 23:27:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 546a073f-3860-4aea-9da5-713d87a3762e from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:27:14 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:27:14 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:27:14 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:27:14 user nova-compute[71516]:   <serial>3c77b710-e771-4ae0-a61f-30aea1088f14</serial>
Apr 11 23:27:14 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:27:14 user nova-compute[71516]: </disk>
Apr 11 23:27:14 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG nova.network.neutron [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updated VIF entry in instance network info cache for port 76adadaa-820a-4fa5-b837-6ef514aa0b8f. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG nova.network.neutron [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updating instance_info_cache with network_info: [{"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] Releasing lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681255634.621789, 546a073f-3860-4aea-9da5-713d87a3762e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:27:14 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Successfully detached device vdb from instance 546a073f-3860-4aea-9da5-713d87a3762e from the live domain config.
Apr 11 23:27:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGljTCNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:27:14 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd8dd59-7f47-4128-b9ff-155c4efc8513]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:27:14 user nova-compute[71516]: No targets found.
Apr 11 23:27:14 user nova-compute[71516]: iSNS:
Apr 11 23:27:14 user nova-compute[71516]: No targets found.
Apr 11 23:27:14 user nova-compute[71516]: STATIC:
Apr 11 23:27:14 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35
Apr 11 23:27:14 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:27:14 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:27:14 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14
Apr 11 23:27:14 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:27:14 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:27:14 user nova-compute[71516]: FIRMWARE:
Apr 11 23:27:14 user nova-compute[71516]: No targets found.
Apr 11 23:27:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:27:14 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:27:14 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4d78db-e8ed-490c-819c-22cfbf07abbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75be7c8-b862-4206-827f-845c95a0a5b4]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:27:14 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:27:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:27:14 user nova-compute[71516]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 (non-flash)
Apr 11 23:27:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5fef4940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee1ada1-5d94-4042-b2e4-11f6728567a9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f43697f-1d02-4df2-8e0f-810c6e6d0f75]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37b0079-7565-4fac-8231-4f6fd2db5c6e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2db8ff-114b-4657-bd9b-55689aed542a]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1fd4e2-5fb9-43d3-a832-7c35062365d0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac892e6-1d68-4b81-ade3-c0519b1b7827]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14, portal: 172.16.0.220,3260]
Apr 11 23:27:14 user nova-compute[71516]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14, portal: 172.16.0.220,3260] successful.
Apr 11 23:27:14 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c77b710-e771-4ae0-a61f-30aea1088f14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8514e85a-9f38-46e6-b981-dab8b728b1f2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] <== disconnect_volume: return (278ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:27:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:27:15 user nova-compute[71516]: DEBUG nova.objects.instance [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'flavor' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:27:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "546a073f-3860-4aea-9da5-713d87a3762e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.639s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-changed-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:27:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Refreshing instance network info cache due to event network-changed-76adadaa-820a-4fa5-b837-6ef514aa0b8f. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:27:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] Acquiring lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:27:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] Acquired lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:27:15 user nova-compute[71516]: DEBUG nova.network.neutron [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Refreshing network info cache for port 76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:27:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:16 user nova-compute[71516]: DEBUG nova.network.neutron [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updated VIF entry in instance network info cache for port 76adadaa-820a-4fa5-b837-6ef514aa0b8f. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:27:16 user nova-compute[71516]: DEBUG nova.network.neutron [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updating instance_info_cache with network_info: [{"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:27:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] Releasing lock "refresh_cache-546a073f-3860-4aea-9da5-713d87a3762e" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:27:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:21 user nova-compute[71516]: INFO nova.compute.manager [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Terminating instance
Apr 11 23:27:21 user nova-compute[71516]: DEBUG nova.compute.manager [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-fd8216be-aa4d-49fd-912f-364acb3211fc req-a90ca45f-663a-4de3-a57d-2702deb416f6 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-vif-unplugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-fd8216be-aa4d-49fd-912f-364acb3211fc req-a90ca45f-663a-4de3-a57d-2702deb416f6 service nova] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-fd8216be-aa4d-49fd-912f-364acb3211fc req-a90ca45f-663a-4de3-a57d-2702deb416f6 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-fd8216be-aa4d-49fd-912f-364acb3211fc req-a90ca45f-663a-4de3-a57d-2702deb416f6 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-fd8216be-aa4d-49fd-912f-364acb3211fc req-a90ca45f-663a-4de3-a57d-2702deb416f6 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] No waiting events found dispatching network-vif-unplugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:27:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-fd8216be-aa4d-49fd-912f-364acb3211fc req-a90ca45f-663a-4de3-a57d-2702deb416f6 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-vif-unplugged-6198de25-d537-4d39-ad81-b8af63bed69e for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:27:22 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Instance destroyed successfully.
Apr 11 23:27:22 user nova-compute[71516]: DEBUG nova.objects.instance [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'resources' on Instance uuid 70323493-f9fa-49e5-a363-b34b9b8907a1 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:27:22 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:22:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-142160481',display_name='tempest-TestMinimumBasicScenario-server-142160481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-142160481',id=38,image_ref='b43563e6-41a8-46f2-9c35-b9e64b84f9cf',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQqGH/kfWyycJV+rfaP6s9LvyHbrOQOqj3ecif3osUput5uwLfhlAG3RPK68uUvF8LN/jHw+/aOHG438K/C3fo0khReoBztMDo8d2EyfaVQ8avg/fYrCuq6mMAW4+vi2g==',key_name='tempest-TestMinimumBasicScenario-838126683',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:22:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e8e126b69d44b27a60c421b86b79e9f',ramdisk_id='',reservation_id='r-18dmt4r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b43563e6-41a8-46f2-9c35-b9e64b84f9cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1152745105',owner_user_name='tempest-TestMinimumBasicScenario-1152745105-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:24:44Z,user_data=None,user_id='6beb3cae81a14fa2bae48a8eedcb3868',uuid=70323493-f9fa-49e5-a363-b34b9b8907a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:27:22 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converting VIF {"id": "6198de25-d537-4d39-ad81-b8af63bed69e", "address": "fa:16:3e:3c:e3:5b", "network": {"id": "12bc1283-756b-41da-93c1-09d86844d45d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1556772755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8e126b69d44b27a60c421b86b79e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198de25-d5", "ovs_interfaceid": "6198de25-d537-4d39-ad81-b8af63bed69e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:27:22 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:e3:5b,bridge_name='br-int',has_traffic_filtering=True,id=6198de25-d537-4d39-ad81-b8af63bed69e,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198de25-d5') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:27:22 user nova-compute[71516]: DEBUG os_vif [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:e3:5b,bridge_name='br-int',has_traffic_filtering=True,id=6198de25-d537-4d39-ad81-b8af63bed69e,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198de25-d5') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:27:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6198de25-d5, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:27:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:27:22 user nova-compute[71516]: INFO os_vif [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:e3:5b,bridge_name='br-int',has_traffic_filtering=True,id=6198de25-d537-4d39-ad81-b8af63bed69e,network=Network(12bc1283-756b-41da-93c1-09d86844d45d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198de25-d5')
Apr 11 23:27:22 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Deleting instance files /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1_del
Apr 11 23:27:22 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Deletion of /opt/stack/data/nova/instances/70323493-f9fa-49e5-a363-b34b9b8907a1_del complete
Apr 11 23:27:22 user nova-compute[71516]: INFO nova.compute.manager [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 23:27:22 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:27:22 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:27:22 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:27:22 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:27:22 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Took 0.46 seconds to deallocate network for instance.
Apr 11 23:27:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:23 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:27:23 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:27:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:23 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Deleted allocations for instance 70323493-f9fa-49e5-a363-b34b9b8907a1
Apr 11 23:27:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.970s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:23 user nova-compute[71516]: DEBUG nova.compute.manager [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:27:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] Acquiring lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] Lock "70323493-f9fa-49e5-a363-b34b9b8907a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:23 user nova-compute[71516]: DEBUG nova.compute.manager [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] No waiting events found dispatching network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:27:23 user nova-compute[71516]: WARNING nova.compute.manager [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received unexpected event network-vif-plugged-6198de25-d537-4d39-ad81-b8af63bed69e for instance with vm_state deleted and task_state None.
Apr 11 23:27:23 user nova-compute[71516]: DEBUG nova.compute.manager [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Received event network-vif-deleted-6198de25-d537-4d39-ad81-b8af63bed69e {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:27:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "de7744d0-487a-49be-9355-fcf1266af37f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:36 user nova-compute[71516]: INFO nova.compute.manager [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Terminating instance
Apr 11 23:27:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:27:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255642.1065369, 70323493-f9fa-49e5-a363-b34b9b8907a1 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:27:37 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] VM Stopped (Lifecycle Event)
Apr 11 23:27:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-25775bdb-a046-4e02-a3bc-b30d510f7dbb None None] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-9e21969d-7269-4d63-9f89-68268d1a6936 req-fcdbed7a-d292-4274-bfbe-18a4836ce090 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received event network-vif-unplugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9e21969d-7269-4d63-9f89-68268d1a6936 req-fcdbed7a-d292-4274-bfbe-18a4836ce090 service nova] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9e21969d-7269-4d63-9f89-68268d1a6936 req-fcdbed7a-d292-4274-bfbe-18a4836ce090 service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9e21969d-7269-4d63-9f89-68268d1a6936 req-fcdbed7a-d292-4274-bfbe-18a4836ce090 service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-9e21969d-7269-4d63-9f89-68268d1a6936 req-fcdbed7a-d292-4274-bfbe-18a4836ce090 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] No waiting events found dispatching network-vif-unplugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-9e21969d-7269-4d63-9f89-68268d1a6936 req-fcdbed7a-d292-4274-bfbe-18a4836ce090 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received event network-vif-unplugged-75723ce6-e923-483c-a830-85c602bb8454 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:37 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Instance destroyed successfully.
Apr 11 23:27:37 user nova-compute[71516]: DEBUG nova.objects.instance [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'resources' on Instance uuid de7744d0-487a-49be-9355-fcf1266af37f {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-865706147',display_name='tempest-ServerActionsTestJSON-server-865706147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-865706147',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:23:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-j4wmwff7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:24:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=de7744d0-487a-49be-9355-fcf1266af37f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "75723ce6-e923-483c-a830-85c602bb8454", "address": "fa:16:3e:a9:87:d4", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75723ce6-e9", "ovs_interfaceid": "75723ce6-e923-483c-a830-85c602bb8454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_vif [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75723ce6-e9, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:37 user nova-compute[71516]: INFO os_vif [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:87:d4,bridge_name='br-int',has_traffic_filtering=True,id=75723ce6-e923-483c-a830-85c602bb8454,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75723ce6-e9')
Apr 11 23:27:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLNugaoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:27:37 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0a129e-7793-4b3e-8bdf-e95826591134]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:27:37 user nova-compute[71516]: No targets found.
Apr 11 23:27:37 user nova-compute[71516]: iSNS:
Apr 11 23:27:37 user nova-compute[71516]: No targets found.
Apr 11 23:27:37 user nova-compute[71516]: STATIC:
Apr 11 23:27:37 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35
Apr 11 23:27:37 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:27:37 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:27:37 user nova-compute[71516]: FIRMWARE:
Apr 11 23:27:37 user nova-compute[71516]: No targets found.
Apr 11 23:27:37 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:27:37 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:27:37 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a04b1a-aa0a-4227-bd02-8eb2b8628f2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5545f711-7758-488c-be74-925308faf5a9]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:27:37 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 (non-flash)
Apr 11 23:27:37 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c57f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35'): ({'sdb'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Removing single pathed devices sdb {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[77523be3-e1a9-4bee-bd01-a8d63b294623]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[430c4612-be38-4cf4-a2db-923eae9b0444]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flushing IO for device /dev/sdb {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f441b89-3d4c-4c05-94ac-61bedf941bb2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e799271-20f5-4d98-90cc-59d70e7c174c]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO25a2e0a6-913a414e2839320d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_25a2e0a6', '/dev/disk/by-id/scsi-23931336134313465') {{(pid=81691) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bf1595-f046-48e5-83d2-f9c8debc5e6d]: (4, None) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2b5159-77d7-46cc-9e81-5c284eae28b7]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6382c6f1-1a82-4375-8677-94c58c57c4b2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260]
Apr 11 23:27:37 user nova-compute[71516]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35, portal: 172.16.0.220,3260] successful.
Apr 11 23:27:37 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33464ef9-378a-4982-8601-296ed0c6bd35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[00194ce1-2ce3-41d4-ae24-27585d1f9c5c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] <== disconnect_volume: return (294ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:27:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:27:37 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Deleting instance files /opt/stack/data/nova/instances/de7744d0-487a-49be-9355-fcf1266af37f_del
Apr 11 23:27:37 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Deletion of /opt/stack/data/nova/instances/de7744d0-487a-49be-9355-fcf1266af37f_del complete
Apr 11 23:27:38 user nova-compute[71516]: INFO nova.compute.manager [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Took 1.13 seconds to destroy the instance on the hypervisor.
Apr 11 23:27:38 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:27:38 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:27:38 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: de7744d0-487a-49be-9355-fcf1266af37f] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:27:38 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:27:38 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Took 0.67 seconds to deallocate network for instance.
Apr 11 23:27:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-ecf0bb77-f600-4a1f-bd42-f1e410a30a40 req-fd791146-3343-4052-ac48-4a7af89bbb4f service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received event network-vif-deleted-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:27:39 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:27:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-e6fdd925-02ba-4de4-88ba-f1ae8ab83ca0 req-ee6867a0-f6c9-4d72-b973-867a7feea494 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received event network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:27:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e6fdd925-02ba-4de4-88ba-f1ae8ab83ca0 req-ee6867a0-f6c9-4d72-b973-867a7feea494 service nova] Acquiring lock "de7744d0-487a-49be-9355-fcf1266af37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e6fdd925-02ba-4de4-88ba-f1ae8ab83ca0 req-ee6867a0-f6c9-4d72-b973-867a7feea494 service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e6fdd925-02ba-4de4-88ba-f1ae8ab83ca0 req-ee6867a0-f6c9-4d72-b973-867a7feea494 service nova] Lock "de7744d0-487a-49be-9355-fcf1266af37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-e6fdd925-02ba-4de4-88ba-f1ae8ab83ca0 req-ee6867a0-f6c9-4d72-b973-867a7feea494 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] No waiting events found dispatching network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:27:39 user nova-compute[71516]: WARNING nova.compute.manager [req-e6fdd925-02ba-4de4-88ba-f1ae8ab83ca0 req-ee6867a0-f6c9-4d72-b973-867a7feea494 service nova] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Received unexpected event network-vif-plugged-75723ce6-e923-483c-a830-85c602bb8454 for instance with vm_state active and task_state deleting.
Apr 11 23:27:39 user nova-compute[71516]: INFO nova.compute.manager [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Took 0.88 seconds to detach 1 volumes for instance.
Apr 11 23:27:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Deleting volume: 33464ef9-378a-4982-8601-296ed0c6bd35 {{(pid=71516) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 23:27:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:39 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:27:39 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:27:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:39 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Deleted allocations for instance de7744d0-487a-49be-9355-fcf1266af37f
Apr 11 23:27:40 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "de7744d0-487a-49be-9355-fcf1266af37f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.140s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:44 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:27:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:27:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:27:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:27:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:27:44 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:27:44 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:27:44 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Updating instance_info_cache with network_info: [{"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:27:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-dd8aa618-99bb-49d7-b547-e5db4470f4c6" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:27:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:27:48 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:27:48 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:27:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8377MB free_disk=26.12755584716797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 546a073f-3860-4aea-9da5-713d87a3762e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance acbc73d0-ab9c-4516-a821-a6dac6b38035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:27:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:27:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:27:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:27:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:27:51 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:27:52 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255657.66693, de7744d0-487a-49be-9355-fcf1266af37f => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:27:52 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: de7744d0-487a-49be-9355-fcf1266af37f] VM Stopped (Lifecycle Event)
Apr 11 23:27:52 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d6970e5c-0c69-4a21-8016-25e5606ee79e None None] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:27:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:27:53 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:27:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:27:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:27:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:27:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:27:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:27:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:27:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:01 user nova-compute[71516]: DEBUG nova.objects.instance [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'flavor' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:02 user nova-compute[71516]: INFO nova.compute.manager [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Attaching volume 32247b58-1467-4245-984b-97ce57899939 to /dev/vdb
Apr 11 23:28:02 user nova-compute[71516]: DEBUG os_brick.utils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e09b93-0427-4916-944a-2b5a12475bbb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d06d3c-855c-448e-a12c-6289da3a600a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c6354e-16d4-48dc-a685-6ecc466b3cc9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5927bd9-b629-449f-b906-3e8c5e2afa24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:28:02 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:28:02 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a03281-863a-4fe3-baeb-0529e71c1161]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG os_brick.utils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Updating existing volume attachment record: b02075b1-1d6a-4784-89d7-9272665c19e1 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:28:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "546a073f-3860-4aea-9da5-713d87a3762e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:04 user nova-compute[71516]: INFO nova.compute.manager [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Terminating instance
Apr 11 23:28:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG nova.compute.manager [req-d357e1b3-2236-416a-be31-c023c6f4b9e8 req-224d8e29-abe2-4641-a561-2cf70ae4d7bd service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-unplugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d357e1b3-2236-416a-be31-c023c6f4b9e8 req-224d8e29-abe2-4641-a561-2cf70ae4d7bd service nova] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d357e1b3-2236-416a-be31-c023c6f4b9e8 req-224d8e29-abe2-4641-a561-2cf70ae4d7bd service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d357e1b3-2236-416a-be31-c023c6f4b9e8 req-224d8e29-abe2-4641-a561-2cf70ae4d7bd service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG nova.compute.manager [req-d357e1b3-2236-416a-be31-c023c6f4b9e8 req-224d8e29-abe2-4641-a561-2cf70ae4d7bd service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] No waiting events found dispatching network-vif-unplugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG nova.compute.manager [req-d357e1b3-2236-416a-be31-c023c6f4b9e8 req-224d8e29-abe2-4641-a561-2cf70ae4d7bd service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-unplugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:05 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Instance destroyed successfully.
Apr 11 23:28:05 user nova-compute[71516]: DEBUG nova.objects.instance [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'resources' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:28:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1543973671',display_name='tempest-ServerRescueNegativeTestJSON-server-1543973671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1543973671',id=37,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrGcGiE4e6Tp38+exR5YT3oDXkSl1ZsauX2FXZ9tTkUu/HLi16m9tlHlzQu5NVP1uorNPN1lADTpqYHlQH1A6/c0JnTeih3uliLzgAEFHnvGzYHnPpZKyFHC5IeclDOHA==',key_name='tempest-keypair-1207488062',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:23:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31c373270f804948a04c8125848fa181',ramdisk_id='',reservation_id='r-6681j8m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-242021724',owner_user_name='tempest-ServerRescueNegativeTestJSON-242021724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:25:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d63779eda794ef0b2413ac1483f88b8',uuid=546a073f-3860-4aea-9da5-713d87a3762e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:28:05 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converting VIF {"id": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "address": "fa:16:3e:7a:74:8a", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adadaa-82", "ovs_interfaceid": "76adadaa-820a-4fa5-b837-6ef514aa0b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:28:05 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=76adadaa-820a-4fa5-b837-6ef514aa0b8f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adadaa-82') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:28:05 user nova-compute[71516]: DEBUG os_vif [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=76adadaa-820a-4fa5-b837-6ef514aa0b8f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adadaa-82') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:28:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76adadaa-82, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:28:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:28:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:05 user nova-compute[71516]: INFO os_vif [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=76adadaa-820a-4fa5-b837-6ef514aa0b8f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adadaa-82')
Apr 11 23:28:05 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Deleting instance files /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e_del
Apr 11 23:28:05 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Deletion of /opt/stack/data/nova/instances/546a073f-3860-4aea-9da5-713d87a3762e_del complete
Apr 11 23:28:05 user nova-compute[71516]: INFO nova.compute.manager [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 11 23:28:05 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:28:05 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:28:05 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:28:06 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Took 1.23 seconds to deallocate network for instance.
Apr 11 23:28:06 user nova-compute[71516]: DEBUG nova.compute.manager [req-d3d28919-dce4-422f-8d87-4401b851c55c req-54975609-bb6d-487e-955b-426074775cfd service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-deleted-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyKsbqpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:28:06 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:28:06 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:28:06 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d820e87-7100-4237-a8d5-b2be183c402e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:28:06 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec64f31d-e20b-422f-985e-fdff825d2809]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939] added
Apr 11 23:28:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf522a01-7a08-4ca5-9743-4fee89fdf1d1]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[70df2c26-c1be-480e-8ae9-e41d08716de0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyKsbqpW {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyKsbqpW" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af2423a-e125-425a-9ead-2ce6553820f8]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GyKsbqpW'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a57ef0f-63e5-4489-a278-5191351890c0]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4706981e-017c-40f1-b646-52afc06d4f82]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 23:28:06 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 23:28:06 user nova-compute[71516]:  {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:28:06 user nova-compute[71516]: WARNING os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 23:28:06 user nova-compute[71516]: 
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG nova.compute.manager [req-4f053803-2c63-46e6-8e2b-cecc0dd20970 req-f7062450-e27a-4d55-bb3a-aadd56000b2d service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4f053803-2c63-46e6-8e2b-cecc0dd20970 req-f7062450-e27a-4d55-bb3a-aadd56000b2d service nova] Acquiring lock "546a073f-3860-4aea-9da5-713d87a3762e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4f053803-2c63-46e6-8e2b-cecc0dd20970 req-f7062450-e27a-4d55-bb3a-aadd56000b2d service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4f053803-2c63-46e6-8e2b-cecc0dd20970 req-f7062450-e27a-4d55-bb3a-aadd56000b2d service nova] Lock "546a073f-3860-4aea-9da5-713d87a3762e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG nova.compute.manager [req-4f053803-2c63-46e6-8e2b-cecc0dd20970 req-f7062450-e27a-4d55-bb3a-aadd56000b2d service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] No waiting events found dispatching network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:28:06 user nova-compute[71516]: WARNING nova.compute.manager [req-4f053803-2c63-46e6-8e2b-cecc0dd20970 req-f7062450-e27a-4d55-bb3a-aadd56000b2d service nova] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Received unexpected event network-vif-plugged-76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance with vm_state deleted and task_state None.
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfa06ca-1165-444e-ba94-4617b395c8f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939, portal: 172.16.0.220,3260]
Apr 11 23:28:06 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939, portal: 172.16.0.220,3260] successful.
Apr 11 23:28:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f728522-523b-43a8-a6ce-12e3f51eafc3]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:06 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Deleted allocations for instance 546a073f-3860-4aea-9da5-713d87a3762e
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d36af33-b46c-4f9c-a71e-7333b6741a51]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 (non-flash)
Apr 11 23:28:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 (non-flash)
Apr 11 23:28:06 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[60695174-f2cd-41fc-85fe-766cc34c5184]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyKsbqpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:28:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "546a073f-3860-4aea-9da5-713d87a3762e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.490s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:28:07 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26335636238666636', 'path': '/dev/sdb'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:28:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335636238666636', 'path': '/dev/sdb'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:28:07 user nova-compute[71516]: DEBUG nova.objects.instance [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'flavor' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:28:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:28:07 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:28:07 user nova-compute[71516]:   <source dev="/dev/sdb"/>
Apr 11 23:28:07 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:28:07 user nova-compute[71516]:   <serial>32247b58-1467-4245-984b-97ce57899939</serial>
Apr 11 23:28:07 user nova-compute[71516]: </disk>
Apr 11 23:28:07 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:28:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:28:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:28:08 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] No VIF found with MAC fa:16:3e:bc:4f:55, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:28:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.262s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:09 user nova-compute[71516]: INFO nova.compute.manager [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Detaching volume 32247b58-1467-4245-984b-97ce57899939
Apr 11 23:28:09 user nova-compute[71516]: INFO nova.virt.block_device [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Attempting to driver detach volume 32247b58-1467-4245-984b-97ce57899939 from mountpoint /dev/vdb
Apr 11 23:28:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Attempting to detach device vdb from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:28:09 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:28:09 user nova-compute[71516]:   <source dev="/dev/sdb"/>
Apr 11 23:28:09 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:28:09 user nova-compute[71516]:   <serial>32247b58-1467-4245-984b-97ce57899939</serial>
Apr 11 23:28:09 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:28:09 user nova-compute[71516]: </disk>
Apr 11 23:28:09 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:28:09 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Successfully detached device vdb from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the persistent domain config.
Apr 11 23:28:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:28:09 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:28:09 user nova-compute[71516]:   <source dev="/dev/sdb"/>
Apr 11 23:28:09 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:28:09 user nova-compute[71516]:   <serial>32247b58-1467-4245-984b-97ce57899939</serial>
Apr 11 23:28:09 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:28:09 user nova-compute[71516]: </disk>
Apr 11 23:28:09 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681255689.7744725, acbc73d0-ab9c-4516-a821-a6dac6b38035 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:28:09 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Successfully detached device vdb from instance acbc73d0-ab9c-4516-a821-a6dac6b38035 from the live domain config.
Apr 11 23:28:09 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyKsbqpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:28:09 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0245b59f-3218-4350-b5ec-4b2f06a49993]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:28:09 user nova-compute[71516]: No targets found.
Apr 11 23:28:09 user nova-compute[71516]: iSNS:
Apr 11 23:28:09 user nova-compute[71516]: No targets found.
Apr 11 23:28:09 user nova-compute[71516]: STATIC:
Apr 11 23:28:09 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939
Apr 11 23:28:09 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:28:09 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:28:09 user nova-compute[71516]: FIRMWARE:
Apr 11 23:28:09 user nova-compute[71516]: No targets found.
Apr 11 23:28:09 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:28:09 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:28:09 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3424f629-f4fe-4bff-a129-e3d80f050bf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[329de538-c6a2-4a3b-9a59-54df8c57f50e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 (non-flash)
Apr 11 23:28:09 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 (non-flash)
Apr 11 23:28:09 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5fda2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939'): ({'sdb'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Removing single pathed devices sdb {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c0eb46-43a8-4461-a7ad-471c8e94652c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22e609f-57d6-46d8-9234-4a05cce080bb]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Flushing IO for device /dev/sdb {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4237b6a-454d-47d6-a027-95044bf06281]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fbb5b5-2d45-4cec-8094-7787d03766f4]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30bf7cc-8d5e-4e49-add8-b869c233c2f8]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:28:09 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d43d92-5130-493d-b2d6-7fa81928dc5d]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939, portal: 172.16.0.220,3260]
Apr 11 23:28:10 user nova-compute[71516]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939, portal: 172.16.0.220,3260] successful.
Apr 11 23:28:10 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:28:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32247b58-1467-4245-984b-97ce57899939 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:10 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4086ca0-b518-43f3-9c36-9ed3e4b75a88]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:28:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:28:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:28:10 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] <== disconnect_volume: return (281ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:28:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:28:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:10 user nova-compute[71516]: DEBUG nova.objects.instance [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'flavor' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:28:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.637s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:20 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255685.1694076, 546a073f-3860-4aea-9da5-713d87a3762e => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:28:20 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] VM Stopped (Lifecycle Event)
Apr 11 23:28:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d2076034-0362-47c2-bb46-9aebf612dff5 None None] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:28:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "e8b26dd1-48ce-476d-99e8-60001f2d7528" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:27 user nova-compute[71516]: INFO nova.compute.manager [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Terminating instance
Apr 11 23:28:27 user nova-compute[71516]: DEBUG nova.compute.manager [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG nova.compute.manager [req-1564579c-ba31-4ea1-8949-92734a4d027e req-21aea1eb-4d89-4974-82fd-91e39362ba1c service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Received event network-vif-unplugged-d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1564579c-ba31-4ea1-8949-92734a4d027e req-21aea1eb-4d89-4974-82fd-91e39362ba1c service nova] Acquiring lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1564579c-ba31-4ea1-8949-92734a4d027e req-21aea1eb-4d89-4974-82fd-91e39362ba1c service nova] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1564579c-ba31-4ea1-8949-92734a4d027e req-21aea1eb-4d89-4974-82fd-91e39362ba1c service nova] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG nova.compute.manager [req-1564579c-ba31-4ea1-8949-92734a4d027e req-21aea1eb-4d89-4974-82fd-91e39362ba1c service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] No waiting events found dispatching network-vif-unplugged-d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:28:27 user nova-compute[71516]: DEBUG nova.compute.manager [req-1564579c-ba31-4ea1-8949-92734a4d027e req-21aea1eb-4d89-4974-82fd-91e39362ba1c service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Received event network-vif-unplugged-d998a3e0-2a86-43bd-8193-a63c4013c7c7 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:28:28 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Instance destroyed successfully.
Apr 11 23:28:28 user nova-compute[71516]: DEBUG nova.objects.instance [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'resources' on Instance uuid e8b26dd1-48ce-476d-99e8-60001f2d7528 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:28:28 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-3910123',display_name='tempest-ServerActionsTestJSON-server-3910123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-3910123',id=33,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw==',key_name='tempest-keypair-1554463927',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:19:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fca37343b414de6b008ad79e022f858',ramdisk_id='',reservation_id='r-osljbtf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-813592275',owner_user_name='tempest-ServerActionsTestJSON-813592275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:19:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7eb14e7174babb8680b4020243c97',uuid=e8b26dd1-48ce-476d-99e8-60001f2d7528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "address": "fa:16:3e:e0:a2:de", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd998a3e0-2a", "ovs_interfaceid": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:28:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converting VIF {"id": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "address": "fa:16:3e:e0:a2:de", "network": {"id": "f9e1c987-17bb-42a1-9005-96fcd25d79c0", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-501245624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fca37343b414de6b008ad79e022f858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd998a3e0-2a", "ovs_interfaceid": "d998a3e0-2a86-43bd-8193-a63c4013c7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:28:28 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a2:de,bridge_name='br-int',has_traffic_filtering=True,id=d998a3e0-2a86-43bd-8193-a63c4013c7c7,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd998a3e0-2a') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:28:28 user nova-compute[71516]: DEBUG os_vif [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a2:de,bridge_name='br-int',has_traffic_filtering=True,id=d998a3e0-2a86-43bd-8193-a63c4013c7c7,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd998a3e0-2a') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:28:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd998a3e0-2a, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:28:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:28:28 user nova-compute[71516]: INFO os_vif [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a2:de,bridge_name='br-int',has_traffic_filtering=True,id=d998a3e0-2a86-43bd-8193-a63c4013c7c7,network=Network(f9e1c987-17bb-42a1-9005-96fcd25d79c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd998a3e0-2a')
Apr 11 23:28:28 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Deleting instance files /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528_del
Apr 11 23:28:28 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Deletion of /opt/stack/data/nova/instances/e8b26dd1-48ce-476d-99e8-60001f2d7528_del complete
Apr 11 23:28:28 user nova-compute[71516]: INFO nova.compute.manager [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 23:28:28 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:28:28 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:28:28 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:28:29 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:28:29 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Took 0.68 seconds to deallocate network for instance.
Apr 11 23:28:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:29 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:28:29 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:28:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:29 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Deleted allocations for instance e8b26dd1-48ce-476d-99e8-60001f2d7528
Apr 11 23:28:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.880s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:30 user nova-compute[71516]: DEBUG nova.compute.manager [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Received event network-vif-plugged-d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:28:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] Acquiring lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:30 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] Lock "e8b26dd1-48ce-476d-99e8-60001f2d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:30 user nova-compute[71516]: DEBUG nova.compute.manager [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] No waiting events found dispatching network-vif-plugged-d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:28:30 user nova-compute[71516]: WARNING nova.compute.manager [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Received unexpected event network-vif-plugged-d998a3e0-2a86-43bd-8193-a63c4013c7c7 for instance with vm_state deleted and task_state None.
Apr 11 23:28:30 user nova-compute[71516]: DEBUG nova.compute.manager [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Received event network-vif-deleted-d998a3e0-2a86-43bd-8193-a63c4013c7c7 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:28:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:28:40 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:28:43 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255708.2789164, e8b26dd1-48ce-476d-99e8-60001f2d7528 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:28:43 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] VM Stopped (Lifecycle Event)
Apr 11 23:28:43 user nova-compute[71516]: DEBUG nova.compute.manager [None req-4125b8cd-5cb6-4e52-88db-8a9ac952ce01 None None] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:28:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:28:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:28:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:28:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:28:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:44 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:28:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:28:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:28:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:28:44 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:28:44 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Updating instance_info_cache with network_info: [{"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:28:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-61204bbb-04fb-4545-ade1-5665c733c5bd" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:28:44 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:28:45 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:46 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:28:47 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:28:47 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:28:47 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:28:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8592MB free_disk=26.187782287597656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:28:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:28:47 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:28:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:28:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 61204bbb-04fb-4545-ade1-5665c733c5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:28:47 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance acbc73d0-ab9c-4516-a821-a6dac6b38035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:28:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:28:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:28:48 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:28:48 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:28:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:28:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:28:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:28:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:28:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:28:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:28:51 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:28:53 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:28:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:28:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:28:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:28:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:28:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:28:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:28:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "61204bbb-04fb-4545-ade1-5665c733c5bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:00 user nova-compute[71516]: INFO nova.compute.manager [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Terminating instance
Apr 11 23:29:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-1087c8d6-7951-45fd-bb58-3b8e113d50df req-ab5fdcc8-ada5-4e61-9461-f50d79c79c22 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received event network-vif-unplugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1087c8d6-7951-45fd-bb58-3b8e113d50df req-ab5fdcc8-ada5-4e61-9461-f50d79c79c22 service nova] Acquiring lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1087c8d6-7951-45fd-bb58-3b8e113d50df req-ab5fdcc8-ada5-4e61-9461-f50d79c79c22 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1087c8d6-7951-45fd-bb58-3b8e113d50df req-ab5fdcc8-ada5-4e61-9461-f50d79c79c22 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-1087c8d6-7951-45fd-bb58-3b8e113d50df req-ab5fdcc8-ada5-4e61-9461-f50d79c79c22 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] No waiting events found dispatching network-vif-unplugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-1087c8d6-7951-45fd-bb58-3b8e113d50df req-ab5fdcc8-ada5-4e61-9461-f50d79c79c22 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received event network-vif-unplugged-6eb4af06-413f-41c6-892b-f2d66653509f for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:01 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Instance destroyed successfully.
Apr 11 23:29:01 user nova-compute[71516]: DEBUG nova.objects.instance [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'resources' on Instance uuid 61204bbb-04fb-4545-ade1-5665c733c5bd {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-7248979',display_name='tempest-ServerRescueNegativeTestJSON-server-7248979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-7248979',id=24,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:14:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31c373270f804948a04c8125848fa181',ramdisk_id='',reservation_id='r-yo5jzi9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-242021724',owner_user_name='tempest-ServerRescueNegativeTestJSON-242021724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:14:59Z,user_data=None,user_id='8d63779eda794ef0b2413ac1483f88b8',uuid=61204bbb-04fb-4545-ade1-5665c733c5bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converting VIF {"id": "6eb4af06-413f-41c6-892b-f2d66653509f", "address": "fa:16:3e:8f:a9:e1", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb4af06-41", "ovs_interfaceid": "6eb4af06-413f-41c6-892b-f2d66653509f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a9:e1,bridge_name='br-int',has_traffic_filtering=True,id=6eb4af06-413f-41c6-892b-f2d66653509f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb4af06-41') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG os_vif [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a9:e1,bridge_name='br-int',has_traffic_filtering=True,id=6eb4af06-413f-41c6-892b-f2d66653509f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb4af06-41') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6eb4af06-41, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:29:01 user nova-compute[71516]: INFO os_vif [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a9:e1,bridge_name='br-int',has_traffic_filtering=True,id=6eb4af06-413f-41c6-892b-f2d66653509f,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb4af06-41')
Apr 11 23:29:01 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Deleting instance files /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd_del
Apr 11 23:29:01 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Deletion of /opt/stack/data/nova/instances/61204bbb-04fb-4545-ade1-5665c733c5bd_del complete
Apr 11 23:29:01 user nova-compute[71516]: INFO nova.compute.manager [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 23:29:01 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:29:01 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Took 0.53 seconds to deallocate network for instance.
Apr 11 23:29:01 user nova-compute[71516]: DEBUG nova.compute.manager [req-1eb964bd-e4d5-4436-b1b6-aea6d7f9e7b1 req-bdab1203-280c-4bf9-a4b3-0ba0e286154d service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received event network-vif-deleted-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:29:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:01 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Deleted allocations for instance 61204bbb-04fb-4545-ade1-5665c733c5bd
Apr 11 23:29:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.751s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:02 user nova-compute[71516]: DEBUG nova.compute.manager [req-b1a9264d-efed-49b7-83cf-196c26219f4c req-a399b401-2e99-4aaf-aca5-a7b1124143d1 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received event network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b1a9264d-efed-49b7-83cf-196c26219f4c req-a399b401-2e99-4aaf-aca5-a7b1124143d1 service nova] Acquiring lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b1a9264d-efed-49b7-83cf-196c26219f4c req-a399b401-2e99-4aaf-aca5-a7b1124143d1 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-b1a9264d-efed-49b7-83cf-196c26219f4c req-a399b401-2e99-4aaf-aca5-a7b1124143d1 service nova] Lock "61204bbb-04fb-4545-ade1-5665c733c5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:02 user nova-compute[71516]: DEBUG nova.compute.manager [req-b1a9264d-efed-49b7-83cf-196c26219f4c req-a399b401-2e99-4aaf-aca5-a7b1124143d1 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] No waiting events found dispatching network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:29:02 user nova-compute[71516]: WARNING nova.compute.manager [req-b1a9264d-efed-49b7-83cf-196c26219f4c req-a399b401-2e99-4aaf-aca5-a7b1124143d1 service nova] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Received unexpected event network-vif-plugged-6eb4af06-413f-41c6-892b-f2d66653509f for instance with vm_state deleted and task_state None.
Apr 11 23:29:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received event network-changed-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Refreshing instance network info cache due to event network-changed-36c83f85-a0e8-4818-9f4f-490d8e14b217. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:29:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] Acquiring lock "refresh_cache-acbc73d0-ab9c-4516-a821-a6dac6b38035" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:29:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] Acquired lock "refresh_cache-acbc73d0-ab9c-4516-a821-a6dac6b38035" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:29:07 user nova-compute[71516]: DEBUG nova.network.neutron [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Refreshing network info cache for port 36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:29:07 user nova-compute[71516]: DEBUG nova.network.neutron [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Updated VIF entry in instance network info cache for port 36c83f85-a0e8-4818-9f4f-490d8e14b217. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:29:07 user nova-compute[71516]: DEBUG nova.network.neutron [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Updating instance_info_cache with network_info: [{"id": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "address": "fa:16:3e:bc:4f:55", "network": {"id": "76b0a0b7-401f-44e6-ace6-bac4e29c0ec4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1458706670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af1370fd8e646d0a5066c42dff5b30f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c83f85-a0", "ovs_interfaceid": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:29:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] Releasing lock "refresh_cache-acbc73d0-ab9c-4516-a821-a6dac6b38035" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:09 user nova-compute[71516]: INFO nova.compute.manager [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Terminating instance
Apr 11 23:29:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-6a212a78-487f-45d5-a170-54b551fa5e63 req-54fa6f8d-19de-4607-b2a5-46caffa26669 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received event network-vif-unplugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6a212a78-487f-45d5-a170-54b551fa5e63 req-54fa6f8d-19de-4607-b2a5-46caffa26669 service nova] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6a212a78-487f-45d5-a170-54b551fa5e63 req-54fa6f8d-19de-4607-b2a5-46caffa26669 service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-6a212a78-487f-45d5-a170-54b551fa5e63 req-54fa6f8d-19de-4607-b2a5-46caffa26669 service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-6a212a78-487f-45d5-a170-54b551fa5e63 req-54fa6f8d-19de-4607-b2a5-46caffa26669 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] No waiting events found dispatching network-vif-unplugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:29:09 user nova-compute[71516]: DEBUG nova.compute.manager [req-6a212a78-487f-45d5-a170-54b551fa5e63 req-54fa6f8d-19de-4607-b2a5-46caffa26669 service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received event network-vif-unplugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Instance destroyed successfully.
Apr 11 23:29:10 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'resources' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1711417485',display_name='tempest-SnapshotDataIntegrityTests-server-1711417485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1711417485',id=39,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUWUtLbTKq+AUj8Uy8O9tvOBWgBrtL+o/73ozA9TTO3DvBRE/6oeST9X/TTWUygilmTDxs/k1hBTXhyEfya0gLgVki/2ncujtXGZV/qXtTHa0+XA4KdKMeiJChGGgeDMQ==',key_name='tempest-SnapshotDataIntegrityTests-1460777543',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:23:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2af1370fd8e646d0a5066c42dff5b30f',ramdisk_id='',reservation_id='r-bcmdt8pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1086939592',owner_user_name='tempest-SnapshotDataIntegrityTests-1086939592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:23:13Z,user_data=None,user_id='e0ebfdb379f540188693c63f74c9ad68',uuid=acbc73d0-ab9c-4516-a821-a6dac6b38035,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "address": "fa:16:3e:bc:4f:55", "network": {"id": "76b0a0b7-401f-44e6-ace6-bac4e29c0ec4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1458706670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af1370fd8e646d0a5066c42dff5b30f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c83f85-a0", "ovs_interfaceid": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Converting VIF {"id": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "address": "fa:16:3e:bc:4f:55", "network": {"id": "76b0a0b7-401f-44e6-ace6-bac4e29c0ec4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1458706670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2af1370fd8e646d0a5066c42dff5b30f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c83f85-a0", "ovs_interfaceid": "36c83f85-a0e8-4818-9f4f-490d8e14b217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:4f:55,bridge_name='br-int',has_traffic_filtering=True,id=36c83f85-a0e8-4818-9f4f-490d8e14b217,network=Network(76b0a0b7-401f-44e6-ace6-bac4e29c0ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c83f85-a0') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG os_vif [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:4f:55,bridge_name='br-int',has_traffic_filtering=True,id=36c83f85-a0e8-4818-9f4f-490d8e14b217,network=Network(76b0a0b7-401f-44e6-ace6-bac4e29c0ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c83f85-a0') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36c83f85-a0, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:29:10 user nova-compute[71516]: INFO os_vif [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:4f:55,bridge_name='br-int',has_traffic_filtering=True,id=36c83f85-a0e8-4818-9f4f-490d8e14b217,network=Network(76b0a0b7-401f-44e6-ace6-bac4e29c0ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c83f85-a0')
Apr 11 23:29:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Deleting instance files /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035_del
Apr 11 23:29:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Deletion of /opt/stack/data/nova/instances/acbc73d0-ab9c-4516-a821-a6dac6b38035_del complete
Apr 11 23:29:10 user nova-compute[71516]: INFO nova.compute.manager [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 11 23:29:10 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:10 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Took 0.48 seconds to deallocate network for instance.
Apr 11 23:29:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-303d6231-b995-49c3-b6c7-3313f9c40bc3 req-febf1a22-965d-4516-9bfd-0e0dea36e10f service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received event network-vif-deleted-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:10 user nova-compute[71516]: INFO nova.compute.manager [req-303d6231-b995-49c3-b6c7-3313f9c40bc3 req-febf1a22-965d-4516-9bfd-0e0dea36e10f service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Neutron deleted interface 36c83f85-a0e8-4818-9f4f-490d8e14b217; detaching it from the instance and deleting it from the info cache
Apr 11 23:29:10 user nova-compute[71516]: DEBUG nova.network.neutron [req-303d6231-b995-49c3-b6c7-3313f9c40bc3 req-febf1a22-965d-4516-9bfd-0e0dea36e10f service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-303d6231-b995-49c3-b6c7-3313f9c40bc3 req-febf1a22-965d-4516-9bfd-0e0dea36e10f service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Detach interface failed, port_id=36c83f85-a0e8-4818-9f4f-490d8e14b217, reason: Instance acbc73d0-ab9c-4516-a821-a6dac6b38035 could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:11 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Deleted allocations for instance acbc73d0-ab9c-4516-a821-a6dac6b38035
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.683s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received event network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] No waiting events found dispatching network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:29:11 user nova-compute[71516]: WARNING nova.compute.manager [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received unexpected event network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance with vm_state deleted and task_state None.
Apr 11 23:29:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received event network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] No waiting events found dispatching network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:29:11 user nova-compute[71516]: WARNING nova.compute.manager [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received unexpected event network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance with vm_state deleted and task_state None.
Apr 11 23:29:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received event network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] No waiting events found dispatching network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:29:11 user nova-compute[71516]: WARNING nova.compute.manager [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received unexpected event network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance with vm_state deleted and task_state None.
Apr 11 23:29:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received event network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Acquiring lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Lock "acbc73d0-ab9c-4516-a821-a6dac6b38035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] No waiting events found dispatching network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:29:11 user nova-compute[71516]: WARNING nova.compute.manager [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Received unexpected event network-vif-plugged-36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance with vm_state deleted and task_state None.
Apr 11 23:29:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:15 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255740.9966404, 61204bbb-04fb-4545-ade1-5665c733c5bd => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:29:15 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] VM Stopped (Lifecycle Event)
Apr 11 23:29:16 user nova-compute[71516]: DEBUG nova.compute.manager [None req-e24d6cc4-54ad-4aeb-b5f0-877a7db95f04 None None] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:29:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:29:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:29:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:29:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:29:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:25 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255750.274288, acbc73d0-ab9c-4516-a821-a6dac6b38035 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:29:25 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] VM Stopped (Lifecycle Event)
Apr 11 23:29:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-8f880581-7c58-49af-b205-ce5ea4965402 None None] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:29:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "cd42372d-ba80-46bb-8ebb-712e6941d62b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:29:33 user nova-compute[71516]: INFO nova.compute.claims [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Claim successful on node user
Apr 11 23:29:33 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG nova.network.neutron [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:29:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:29:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG nova.policy [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:29:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Creating image(s)
Apr 11 23:29:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "/opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "/opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.130s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk 1073741824" returned: 0 in 0.047s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG nova.network.neutron [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Successfully created port: b9392b00-89bf-40ad-bcfa-4278fa388813 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Cannot resize image /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG nova.objects.instance [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'migration_context' on Instance uuid cd42372d-ba80-46bb-8ebb-712e6941d62b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Ensure instance console log exists: /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Successfully updated port: b9392b00-89bf-40ad-bcfa-4278fa388813 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquired lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Received event network-changed-b9392b00-89bf-40ad-bcfa-4278fa388813 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Refreshing instance network info cache due to event network-changed-b9392b00-89bf-40ad-bcfa-4278fa388813. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] Acquiring lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updating instance_info_cache with network_info: [{"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Releasing lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Instance network_info: |[{"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] Acquired lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.network.neutron [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Refreshing network info cache for port b9392b00-89bf-40ad-bcfa-4278fa388813 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Start _get_guest_xml network_info=[{"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:29:35 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:29:35 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:29:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-600598354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-600598354',id=40,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-baham0s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:29:34Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=cd42372d-ba80-46bb-8ebb-712e6941d62b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:04:24,bridge_name='br-int',has_traffic_filtering=True,id=b9392b00-89bf-40ad-bcfa-4278fa388813,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9392b00-89') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.objects.instance [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'pci_devices' on Instance uuid cd42372d-ba80-46bb-8ebb-712e6941d62b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:29:35 user nova-compute[71516]:   <uuid>cd42372d-ba80-46bb-8ebb-712e6941d62b</uuid>
Apr 11 23:29:35 user nova-compute[71516]:   <name>instance-00000028</name>
Apr 11 23:29:35 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:29:35 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:29:35 user nova-compute[71516]:   <metadata>
Apr 11 23:29:35 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:29:35 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:29:35 user nova-compute[71516]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-600598354</nova:name>
Apr 11 23:29:35 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:29:35</nova:creationTime>
Apr 11 23:29:35 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:29:35 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:29:35 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:29:35 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:29:35 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:29:35 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:29:35 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:29:35 user nova-compute[71516]:       <nova:owner>
Apr 11 23:29:35 user nova-compute[71516]:         <nova:user uuid="34d0482650674249adb77724a287d53e">tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member</nova:user>
Apr 11 23:29:35 user nova-compute[71516]:         <nova:project uuid="5d1c7064a4f845d1b39a49795d00d9b0">tempest-ServerBootFromVolumeStableRescueTest-948037051</nova:project>
Apr 11 23:29:35 user nova-compute[71516]:       </nova:owner>
Apr 11 23:29:35 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:29:35 user nova-compute[71516]:       <nova:ports>
Apr 11 23:29:35 user nova-compute[71516]:         <nova:port uuid="b9392b00-89bf-40ad-bcfa-4278fa388813">
Apr 11 23:29:35 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 23:29:35 user nova-compute[71516]:         </nova:port>
Apr 11 23:29:35 user nova-compute[71516]:       </nova:ports>
Apr 11 23:29:35 user nova-compute[71516]:     </nova:instance>
Apr 11 23:29:35 user nova-compute[71516]:   </metadata>
Apr 11 23:29:35 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:29:35 user nova-compute[71516]:     <system>
Apr 11 23:29:35 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:29:35 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:29:35 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:29:35 user nova-compute[71516]:       <entry name="serial">cd42372d-ba80-46bb-8ebb-712e6941d62b</entry>
Apr 11 23:29:35 user nova-compute[71516]:       <entry name="uuid">cd42372d-ba80-46bb-8ebb-712e6941d62b</entry>
Apr 11 23:29:35 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:29:35 user nova-compute[71516]:     </system>
Apr 11 23:29:35 user nova-compute[71516]:   </sysinfo>
Apr 11 23:29:35 user nova-compute[71516]:   <os>
Apr 11 23:29:35 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:29:35 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:29:35 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:29:35 user nova-compute[71516]:   </os>
Apr 11 23:29:35 user nova-compute[71516]:   <features>
Apr 11 23:29:35 user nova-compute[71516]:     <acpi/>
Apr 11 23:29:35 user nova-compute[71516]:     <apic/>
Apr 11 23:29:35 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:29:35 user nova-compute[71516]:   </features>
Apr 11 23:29:35 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:29:35 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:29:35 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:29:35 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:29:35 user nova-compute[71516]:   </clock>
Apr 11 23:29:35 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:29:35 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:29:35 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:29:35 user nova-compute[71516]:   </cpu>
Apr 11 23:29:35 user nova-compute[71516]:   <devices>
Apr 11 23:29:35 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:29:35 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:29:35 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk"/>
Apr 11 23:29:35 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:29:35 user nova-compute[71516]:     </disk>
Apr 11 23:29:35 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:29:35 user nova-compute[71516]:       <mac address="fa:16:3e:f0:04:24"/>
Apr 11 23:29:35 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:29:35 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:29:35 user nova-compute[71516]:       <target dev="tapb9392b00-89"/>
Apr 11 23:29:35 user nova-compute[71516]:     </interface>
Apr 11 23:29:35 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:29:35 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/console.log" append="off"/>
Apr 11 23:29:35 user nova-compute[71516]:     </serial>
Apr 11 23:29:35 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:29:35 user nova-compute[71516]:     <video>
Apr 11 23:29:35 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:29:35 user nova-compute[71516]:     </video>
Apr 11 23:29:35 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:29:35 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:29:35 user nova-compute[71516]:     </rng>
Apr 11 23:29:35 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:29:35 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:29:35 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:29:35 user nova-compute[71516]:     </memballoon>
Apr 11 23:29:35 user nova-compute[71516]:   </devices>
Apr 11 23:29:35 user nova-compute[71516]: </domain>
Apr 11 23:29:35 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:29:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-600598354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-600598354',id=40,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-baham0s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:29:34Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=cd42372d-ba80-46bb-8ebb-712e6941d62b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:04:24,bridge_name='br-int',has_traffic_filtering=True,id=b9392b00-89bf-40ad-bcfa-4278fa388813,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9392b00-89') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG os_vif [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:04:24,bridge_name='br-int',has_traffic_filtering=True,id=b9392b00-89bf-40ad-bcfa-4278fa388813,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9392b00-89') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9392b00-89, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9392b00-89, col_values=(('external_ids', {'iface-id': 'b9392b00-89bf-40ad-bcfa-4278fa388813', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:04:24', 'vm-uuid': 'cd42372d-ba80-46bb-8ebb-712e6941d62b'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:35 user nova-compute[71516]: INFO os_vif [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:04:24,bridge_name='br-int',has_traffic_filtering=True,id=b9392b00-89bf-40ad-bcfa-4278fa388813,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9392b00-89')
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No VIF found with MAC fa:16:3e:f0:04:24, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.network.neutron [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updated VIF entry in instance network info cache for port b9392b00-89bf-40ad-bcfa-4278fa388813. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG nova.network.neutron [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updating instance_info_cache with network_info: [{"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:29:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] Releasing lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:29:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-c6b8ab56-6976-4276-ab7c-0d4134e4cc07 req-710d6ee4-d464-4371-aa98-c2054a372bea service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Received event network-vif-plugged-b9392b00-89bf-40ad-bcfa-4278fa388813 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c6b8ab56-6976-4276-ab7c-0d4134e4cc07 req-710d6ee4-d464-4371-aa98-c2054a372bea service nova] Acquiring lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c6b8ab56-6976-4276-ab7c-0d4134e4cc07 req-710d6ee4-d464-4371-aa98-c2054a372bea service nova] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c6b8ab56-6976-4276-ab7c-0d4134e4cc07 req-710d6ee4-d464-4371-aa98-c2054a372bea service nova] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-c6b8ab56-6976-4276-ab7c-0d4134e4cc07 req-710d6ee4-d464-4371-aa98-c2054a372bea service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] No waiting events found dispatching network-vif-plugged-b9392b00-89bf-40ad-bcfa-4278fa388813 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:29:37 user nova-compute[71516]: WARNING nova.compute.manager [req-c6b8ab56-6976-4276-ab7c-0d4134e4cc07 req-710d6ee4-d464-4371-aa98-c2054a372bea service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Received unexpected event network-vif-plugged-b9392b00-89bf-40ad-bcfa-4278fa388813 for instance with vm_state building and task_state spawning.
Apr 11 23:29:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:38 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255778.956929, cd42372d-ba80-46bb-8ebb-712e6941d62b => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:29:38 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] VM Resumed (Lifecycle Event)
Apr 11 23:29:38 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:29:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:29:38 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Instance spawned successfully.
Apr 11 23:29:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:29:38 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:29:38 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:29:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:29:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:29:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:29:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:29:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:29:38 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:29:39 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:29:39 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255778.9592776, cd42372d-ba80-46bb-8ebb-712e6941d62b => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:29:39 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] VM Started (Lifecycle Event)
Apr 11 23:29:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:29:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:29:39 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:29:39 user nova-compute[71516]: INFO nova.compute.manager [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Took 5.33 seconds to spawn the instance on the hypervisor.
Apr 11 23:29:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:29:39 user nova-compute[71516]: INFO nova.compute.manager [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Took 5.84 seconds to build instance.
Apr 11 23:29:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.940s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-570e2ce6-7b28-4973-9c22-a2eb1d3bd68f req-6aaada4c-296b-43c4-858b-f9c6f2f1f320 service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Received event network-vif-plugged-b9392b00-89bf-40ad-bcfa-4278fa388813 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-570e2ce6-7b28-4973-9c22-a2eb1d3bd68f req-6aaada4c-296b-43c4-858b-f9c6f2f1f320 service nova] Acquiring lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-570e2ce6-7b28-4973-9c22-a2eb1d3bd68f req-6aaada4c-296b-43c4-858b-f9c6f2f1f320 service nova] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-570e2ce6-7b28-4973-9c22-a2eb1d3bd68f req-6aaada4c-296b-43c4-858b-f9c6f2f1f320 service nova] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-570e2ce6-7b28-4973-9c22-a2eb1d3bd68f req-6aaada4c-296b-43c4-858b-f9c6f2f1f320 service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] No waiting events found dispatching network-vif-plugged-b9392b00-89bf-40ad-bcfa-4278fa388813 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:29:39 user nova-compute[71516]: WARNING nova.compute.manager [req-570e2ce6-7b28-4973-9c22-a2eb1d3bd68f req-6aaada4c-296b-43c4-858b-f9c6f2f1f320 service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Received unexpected event network-vif-plugged-b9392b00-89bf-40ad-bcfa-4278fa388813 for instance with vm_state active and task_state None.
Apr 11 23:29:40 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:29:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:45 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:29:45 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:29:45 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:29:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:48 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:29:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:48 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:29:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:29:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:29:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:29:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:29:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:29:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:29:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:29:48 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:29:49 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:29:49 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:29:49 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=26.242794036865234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:29:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:49 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:29:49 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:29:49 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:29:49 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:29:49 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:29:49 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:29:49 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:29:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:50 user nova-compute[71516]: INFO nova.compute.manager [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Terminating instance
Apr 11 23:29:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:29:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:51 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Instance destroyed successfully.
Apr 11 23:29:51 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'resources' on Instance uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1692522881',display_name='tempest-ServerRescueNegativeTestJSON-server-1692522881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1692522881',id=23,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:17:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31c373270f804948a04c8125848fa181',ramdisk_id='',reservation_id='r-wpvajt0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-242021724',owner_user_name='tempest-ServerRescueNegativeTestJSON-242021724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:19:42Z,user_data=None,user_id='8d63779eda794ef0b2413ac1483f88b8',uuid=dd8aa618-99bb-49d7-b547-e5db4470f4c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converting VIF {"id": "af81e577-93ac-47a7-8666-377d53fad5c2", "address": "fa:16:3e:24:11:46", "network": {"id": "4c17359e-31c1-483d-a0cd-920c089c1405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1613792160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31c373270f804948a04c8125848fa181", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf81e577-93", "ovs_interfaceid": "af81e577-93ac-47a7-8666-377d53fad5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:11:46,bridge_name='br-int',has_traffic_filtering=True,id=af81e577-93ac-47a7-8666-377d53fad5c2,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81e577-93') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG os_vif [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:11:46,bridge_name='br-int',has_traffic_filtering=True,id=af81e577-93ac-47a7-8666-377d53fad5c2,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81e577-93') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf81e577-93, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:29:51 user nova-compute[71516]: INFO os_vif [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:11:46,bridge_name='br-int',has_traffic_filtering=True,id=af81e577-93ac-47a7-8666-377d53fad5c2,network=Network(4c17359e-31c1-483d-a0cd-920c089c1405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf81e577-93')
Apr 11 23:29:51 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Deleting instance files /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6_del
Apr 11 23:29:51 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Deletion of /opt/stack/data/nova/instances/dd8aa618-99bb-49d7-b547-e5db4470f4c6_del complete
Apr 11 23:29:51 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:29:51 user nova-compute[71516]: INFO nova.compute.manager [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 11 23:29:51 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-24ba7ca6-29ac-4838-a40c-d6f50b90df6c req-06c2baf2-a8c1-4b82-a776-9ffdb7beea08 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-unplugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-24ba7ca6-29ac-4838-a40c-d6f50b90df6c req-06c2baf2-a8c1-4b82-a776-9ffdb7beea08 service nova] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-24ba7ca6-29ac-4838-a40c-d6f50b90df6c req-06c2baf2-a8c1-4b82-a776-9ffdb7beea08 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-24ba7ca6-29ac-4838-a40c-d6f50b90df6c req-06c2baf2-a8c1-4b82-a776-9ffdb7beea08 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-24ba7ca6-29ac-4838-a40c-d6f50b90df6c req-06c2baf2-a8c1-4b82-a776-9ffdb7beea08 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] No waiting events found dispatching network-vif-unplugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:29:51 user nova-compute[71516]: DEBUG nova.compute.manager [req-24ba7ca6-29ac-4838-a40c-d6f50b90df6c req-06c2baf2-a8c1-4b82-a776-9ffdb7beea08 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-unplugged-af81e577-93ac-47a7-8666-377d53fad5c2 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:29:52 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:29:52 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:29:52 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Took 0.90 seconds to deallocate network for instance.
Apr 11 23:29:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-bc82332c-c147-4213-9f7d-124928e01995 req-264c2363-b6f8-4707-ab49-85e2eaf1e654 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-deleted-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:52 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:29:52 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:29:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:52 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Deleted allocations for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6
Apr 11 23:29:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.008s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:53 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:29:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-899bab34-dd03-45ae-b1f4-71e4675daceb req-8a1c6346-6642-4ddb-a0f2-a1e748e1cd13 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:29:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-899bab34-dd03-45ae-b1f4-71e4675daceb req-8a1c6346-6642-4ddb-a0f2-a1e748e1cd13 service nova] Acquiring lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:29:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-899bab34-dd03-45ae-b1f4-71e4675daceb req-8a1c6346-6642-4ddb-a0f2-a1e748e1cd13 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:29:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-899bab34-dd03-45ae-b1f4-71e4675daceb req-8a1c6346-6642-4ddb-a0f2-a1e748e1cd13 service nova] Lock "dd8aa618-99bb-49d7-b547-e5db4470f4c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:29:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-899bab34-dd03-45ae-b1f4-71e4675daceb req-8a1c6346-6642-4ddb-a0f2-a1e748e1cd13 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] No waiting events found dispatching network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:29:53 user nova-compute[71516]: WARNING nova.compute.manager [req-899bab34-dd03-45ae-b1f4-71e4675daceb req-8a1c6346-6642-4ddb-a0f2-a1e748e1cd13 service nova] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Received unexpected event network-vif-plugged-af81e577-93ac-47a7-8666-377d53fad5c2 for instance with vm_state deleted and task_state None.
Apr 11 23:29:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:29:58 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:30:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:06 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681255791.415513, dd8aa618-99bb-49d7-b547-e5db4470f4c6 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:30:06 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] VM Stopped (Lifecycle Event)
Apr 11 23:30:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-788468df-99e2-44b6-a967-779e86e3471a None None] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:30:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:30:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:30:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:33 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:30:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 23:30:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] There are 0 instances to clean {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 23:30:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:42 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:30:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:46 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:30:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:30:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:30:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:30:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:30:46 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:30:46 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid cd42372d-ba80-46bb-8ebb-712e6941d62b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:30:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:46 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updating instance_info_cache with network_info: [{"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:30:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:30:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:30:49 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:30:49 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:30:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:30:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:30:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:30:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:30:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:30:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:30:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:30:50 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:30:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:30:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:30:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:30:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:30:50 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:30:50 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:30:51 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=26.241161346435547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:30:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:30:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:30:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:51 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:30:51 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:30:51 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:30:51 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:30:51 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:30:51 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:30:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:30:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:30:52 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:30:54 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:30:55 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:30:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:30:58 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:30:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances with incomplete migration  {{(pid=71516) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 23:31:00 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:31:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:31:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:31:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:12 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_power_states {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:31:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid cd42372d-ba80-46bb-8ebb-712e6941d62b {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:31:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "cd42372d-ba80-46bb-8ebb-712e6941d62b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:31:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:31:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:31:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:31:24 user nova-compute[71516]: INFO nova.compute.manager [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] instance snapshotting
Apr 11 23:31:24 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Beginning live snapshot process
Apr 11 23:31:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json -f qcow2 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json -f qcow2 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8bkh7ov0/ecd4430b8a3b4ddaba2e962c0791eb3c.delta 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8bkh7ov0/ecd4430b8a3b4ddaba2e962c0791eb3c.delta 1073741824" returned: 0 in 0.048s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:25 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 23:31:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:31:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:31:26 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 23:31:26 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:31:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8bkh7ov0/ecd4430b8a3b4ddaba2e962c0791eb3c.delta /opt/stack/data/nova/instances/snapshots/tmp8bkh7ov0/ecd4430b8a3b4ddaba2e962c0791eb3c {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8bkh7ov0/ecd4430b8a3b4ddaba2e962c0791eb3c.delta /opt/stack/data/nova/instances/snapshots/tmp8bkh7ov0/ecd4430b8a3b4ddaba2e962c0791eb3c" returned: 0 in 0.527s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:27 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Snapshot extracted, beginning image upload
Apr 11 23:31:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:29 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Snapshot image upload complete
Apr 11 23:31:29 user nova-compute[71516]: INFO nova.compute.manager [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Took 4.94 seconds to snapshot the instance on the hypervisor.
Apr 11 23:31:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:31:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:31:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:31:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:31:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:31:33 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:31:33 user nova-compute[71516]: INFO nova.compute.claims [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Claim successful on node user
Apr 11 23:31:33 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:31:33 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:31:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:31:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:31:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:31:33 user nova-compute[71516]: DEBUG nova.network.neutron [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:31:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:31:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG nova.policy [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fba33ae43c34bbba115df1e892b2034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bef1ddbef124fff82634357a1db9594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:31:34 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Creating image(s)
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "/opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "/opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "/opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk 1073741824" returned: 0 in 0.057s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Cannot resize image /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG nova.objects.instance [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'migration_context' on Instance uuid 6daabd9b-ed06-4bfc-a323-e464f5e29b3c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Ensure instance console log exists: /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:31:34 user nova-compute[71516]: DEBUG nova.network.neutron [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Successfully created port: 5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:31:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Successfully updated port: 5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:31:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:31:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquired lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:31:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:31:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Received event network-changed-5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:31:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Refreshing instance network info cache due to event network-changed-5b75ff13-136e-4805-9959-478fe1165c45. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:31:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] Acquiring lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:31:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.network.neutron [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updating instance_info_cache with network_info: [{"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Releasing lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.compute.manager [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Instance network_info: |[{"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] Acquired lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Refreshing network info cache for port 5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Start _get_guest_xml network_info=[{"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:31:36 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:31:36 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:31:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1183745125',display_name='tempest-TestStampPattern-server-1183745125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1183745125',id=41,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDPm4ZPOCf1l7GfxihjBWYCbrccfGFsoS4jnE01iprxBmAib6g39KNKImt4ZLVsCOh1eFL88paYMZusOg3ArGPCcKgWAPxJaKEnhN2keDRL16gSTkvFeR2q1Q375pTqdw==',key_name='tempest-TestStampPattern-718348001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bef1ddbef124fff82634357a1db9594',ramdisk_id='',reservation_id='r-ai5slsvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1577365278',owner_user_name='tempest-TestStampPattern-1577365278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:31:34Z,user_data=None,user_id='3fba33ae43c34bbba115df1e892b2034',uuid=6daabd9b-ed06-4bfc-a323-e464f5e29b3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Converting VIF {"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:bc:44,bridge_name='br-int',has_traffic_filtering=True,id=5b75ff13-136e-4805-9959-478fe1165c45,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b75ff13-13') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.objects.instance [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'pci_devices' on Instance uuid 6daabd9b-ed06-4bfc-a323-e464f5e29b3c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:31:36 user nova-compute[71516]:   <uuid>6daabd9b-ed06-4bfc-a323-e464f5e29b3c</uuid>
Apr 11 23:31:36 user nova-compute[71516]:   <name>instance-00000029</name>
Apr 11 23:31:36 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:31:36 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:31:36 user nova-compute[71516]:   <metadata>
Apr 11 23:31:36 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:31:36 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:31:36 user nova-compute[71516]:       <nova:name>tempest-TestStampPattern-server-1183745125</nova:name>
Apr 11 23:31:36 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:31:36</nova:creationTime>
Apr 11 23:31:36 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:31:36 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:31:36 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:31:36 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:31:36 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:31:36 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:31:36 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:31:36 user nova-compute[71516]:       <nova:owner>
Apr 11 23:31:36 user nova-compute[71516]:         <nova:user uuid="3fba33ae43c34bbba115df1e892b2034">tempest-TestStampPattern-1577365278-project-member</nova:user>
Apr 11 23:31:36 user nova-compute[71516]:         <nova:project uuid="6bef1ddbef124fff82634357a1db9594">tempest-TestStampPattern-1577365278</nova:project>
Apr 11 23:31:36 user nova-compute[71516]:       </nova:owner>
Apr 11 23:31:36 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:31:36 user nova-compute[71516]:       <nova:ports>
Apr 11 23:31:36 user nova-compute[71516]:         <nova:port uuid="5b75ff13-136e-4805-9959-478fe1165c45">
Apr 11 23:31:36 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 23:31:36 user nova-compute[71516]:         </nova:port>
Apr 11 23:31:36 user nova-compute[71516]:       </nova:ports>
Apr 11 23:31:36 user nova-compute[71516]:     </nova:instance>
Apr 11 23:31:36 user nova-compute[71516]:   </metadata>
Apr 11 23:31:36 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:31:36 user nova-compute[71516]:     <system>
Apr 11 23:31:36 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:31:36 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:31:36 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:31:36 user nova-compute[71516]:       <entry name="serial">6daabd9b-ed06-4bfc-a323-e464f5e29b3c</entry>
Apr 11 23:31:36 user nova-compute[71516]:       <entry name="uuid">6daabd9b-ed06-4bfc-a323-e464f5e29b3c</entry>
Apr 11 23:31:36 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:31:36 user nova-compute[71516]:     </system>
Apr 11 23:31:36 user nova-compute[71516]:   </sysinfo>
Apr 11 23:31:36 user nova-compute[71516]:   <os>
Apr 11 23:31:36 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:31:36 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:31:36 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:31:36 user nova-compute[71516]:   </os>
Apr 11 23:31:36 user nova-compute[71516]:   <features>
Apr 11 23:31:36 user nova-compute[71516]:     <acpi/>
Apr 11 23:31:36 user nova-compute[71516]:     <apic/>
Apr 11 23:31:36 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:31:36 user nova-compute[71516]:   </features>
Apr 11 23:31:36 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:31:36 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:31:36 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:31:36 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:31:36 user nova-compute[71516]:   </clock>
Apr 11 23:31:36 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:31:36 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:31:36 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:31:36 user nova-compute[71516]:   </cpu>
Apr 11 23:31:36 user nova-compute[71516]:   <devices>
Apr 11 23:31:36 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:31:36 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:31:36 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk"/>
Apr 11 23:31:36 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:31:36 user nova-compute[71516]:     </disk>
Apr 11 23:31:36 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:31:36 user nova-compute[71516]:       <mac address="fa:16:3e:ab:bc:44"/>
Apr 11 23:31:36 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:31:36 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:31:36 user nova-compute[71516]:       <target dev="tap5b75ff13-13"/>
Apr 11 23:31:36 user nova-compute[71516]:     </interface>
Apr 11 23:31:36 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:31:36 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/console.log" append="off"/>
Apr 11 23:31:36 user nova-compute[71516]:     </serial>
Apr 11 23:31:36 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:31:36 user nova-compute[71516]:     <video>
Apr 11 23:31:36 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:31:36 user nova-compute[71516]:     </video>
Apr 11 23:31:36 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:31:36 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:31:36 user nova-compute[71516]:     </rng>
Apr 11 23:31:36 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:31:36 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:31:36 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:31:36 user nova-compute[71516]:     </memballoon>
Apr 11 23:31:36 user nova-compute[71516]:   </devices>
Apr 11 23:31:36 user nova-compute[71516]: </domain>
Apr 11 23:31:36 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:31:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1183745125',display_name='tempest-TestStampPattern-server-1183745125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1183745125',id=41,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDPm4ZPOCf1l7GfxihjBWYCbrccfGFsoS4jnE01iprxBmAib6g39KNKImt4ZLVsCOh1eFL88paYMZusOg3ArGPCcKgWAPxJaKEnhN2keDRL16gSTkvFeR2q1Q375pTqdw==',key_name='tempest-TestStampPattern-718348001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bef1ddbef124fff82634357a1db9594',ramdisk_id='',reservation_id='r-ai5slsvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1577365278',owner_user_name='tempest-TestStampPattern-1577365278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:31:34Z,user_data=None,user_id='3fba33ae43c34bbba115df1e892b2034',uuid=6daabd9b-ed06-4bfc-a323-e464f5e29b3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Converting VIF {"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:bc:44,bridge_name='br-int',has_traffic_filtering=True,id=5b75ff13-136e-4805-9959-478fe1165c45,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b75ff13-13') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG os_vif [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:bc:44,bridge_name='br-int',has_traffic_filtering=True,id=5b75ff13-136e-4805-9959-478fe1165c45,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b75ff13-13') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b75ff13-13, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b75ff13-13, col_values=(('external_ids', {'iface-id': '5b75ff13-136e-4805-9959-478fe1165c45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:bc:44', 'vm-uuid': '6daabd9b-ed06-4bfc-a323-e464f5e29b3c'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:36 user nova-compute[71516]: INFO os_vif [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:bc:44,bridge_name='br-int',has_traffic_filtering=True,id=5b75ff13-136e-4805-9959-478fe1165c45,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b75ff13-13')
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] No VIF found with MAC fa:16:3e:ab:bc:44, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updated VIF entry in instance network info cache for port 5b75ff13-136e-4805-9959-478fe1165c45. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updating instance_info_cache with network_info: [{"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:31:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] Releasing lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:31:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-eff97d8a-ddf1-4be1-80ac-747e9b0a3c4d req-ed033cd1-37bd-4694-ac16-fe33799a92a7 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Received event network-vif-plugged-5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:31:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-eff97d8a-ddf1-4be1-80ac-747e9b0a3c4d req-ed033cd1-37bd-4694-ac16-fe33799a92a7 service nova] Acquiring lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:31:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-eff97d8a-ddf1-4be1-80ac-747e9b0a3c4d req-ed033cd1-37bd-4694-ac16-fe33799a92a7 service nova] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:31:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-eff97d8a-ddf1-4be1-80ac-747e9b0a3c4d req-ed033cd1-37bd-4694-ac16-fe33799a92a7 service nova] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:31:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-eff97d8a-ddf1-4be1-80ac-747e9b0a3c4d req-ed033cd1-37bd-4694-ac16-fe33799a92a7 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] No waiting events found dispatching network-vif-plugged-5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:31:37 user nova-compute[71516]: WARNING nova.compute.manager [req-eff97d8a-ddf1-4be1-80ac-747e9b0a3c4d req-ed033cd1-37bd-4694-ac16-fe33799a92a7 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Received unexpected event network-vif-plugged-5b75ff13-136e-4805-9959-478fe1165c45 for instance with vm_state building and task_state spawning.
Apr 11 23:31:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255899.7619014, 6daabd9b-ed06-4bfc-a323-e464f5e29b3c => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:31:39 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] VM Resumed (Lifecycle Event)
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:31:39 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Instance spawned successfully.
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:31:39 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255899.7620678, 6daabd9b-ed06-4bfc-a323-e464f5e29b3c => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:31:39 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] VM Started (Lifecycle Event)
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:31:39 user nova-compute[71516]: INFO nova.compute.manager [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Took 5.80 seconds to spawn the instance on the hypervisor.
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.compute.manager [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:31:39 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-2772e561-03aa-466a-99f1-96c7319d91c2 req-998d60b6-fe09-499b-88ec-a4493392262e service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Received event network-vif-plugged-5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2772e561-03aa-466a-99f1-96c7319d91c2 req-998d60b6-fe09-499b-88ec-a4493392262e service nova] Acquiring lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2772e561-03aa-466a-99f1-96c7319d91c2 req-998d60b6-fe09-499b-88ec-a4493392262e service nova] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2772e561-03aa-466a-99f1-96c7319d91c2 req-998d60b6-fe09-499b-88ec-a4493392262e service nova] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:31:39 user nova-compute[71516]: DEBUG nova.compute.manager [req-2772e561-03aa-466a-99f1-96c7319d91c2 req-998d60b6-fe09-499b-88ec-a4493392262e service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] No waiting events found dispatching network-vif-plugged-5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:31:39 user nova-compute[71516]: WARNING nova.compute.manager [req-2772e561-03aa-466a-99f1-96c7319d91c2 req-998d60b6-fe09-499b-88ec-a4493392262e service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Received unexpected event network-vif-plugged-5b75ff13-136e-4805-9959-478fe1165c45 for instance with vm_state building and task_state spawning.
Apr 11 23:31:39 user nova-compute[71516]: INFO nova.compute.manager [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Took 6.37 seconds to build instance.
Apr 11 23:31:39 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.464s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:31:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:43 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:31:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:48 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:31:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:31:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:31:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:31:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:31:48 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:31:48 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid cd42372d-ba80-46bb-8ebb-712e6941d62b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:31:48 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updating instance_info_cache with network_info: [{"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:31:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:31:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:31:50 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:51 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:31:51 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:31:51 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8647MB free_disk=26.192813873291016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing inventories for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating ProviderTree inventory for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating inventory in ProviderTree for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing aggregate associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, aggregates: None {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing trait associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:31:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:31:52 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:31:53 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:31:54 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:31:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:31:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:31:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:02 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:32:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:32:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:32:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:32:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:32:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:32:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:32:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:32:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:32:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:32:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "16682788-70d1-400d-adc3-0518282c04fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:32:31 user nova-compute[71516]: INFO nova.compute.claims [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Claim successful on node user
Apr 11 23:32:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:32:31 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:32:31 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:32:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:32:31 user nova-compute[71516]: INFO nova.virt.block_device [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Booting with blank volume at /dev/vda
Apr 11 23:32:31 user nova-compute[71516]: DEBUG nova.policy [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:32:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Successfully created port: 624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:32:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Successfully updated port: 624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:32:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:32:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquired lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:32:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:32:32 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:32:32 user nova-compute[71516]: DEBUG nova.compute.manager [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-changed-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:32:32 user nova-compute[71516]: DEBUG nova.compute.manager [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Refreshing instance network info cache due to event network-changed-624afba1-f295-47d2-8419-91f51beeb2a8. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:32:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] Acquiring lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:32:33 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updating instance_info_cache with network_info: [{"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:32:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Releasing lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:32:33 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Instance network_info: |[{"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:32:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] Acquired lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:32:33 user nova-compute[71516]: DEBUG nova.network.neutron [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Refreshing network info cache for port 624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:32:33 user nova-compute[71516]: DEBUG nova.network.neutron [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updated VIF entry in instance network info cache for port 624afba1-f295-47d2-8419-91f51beeb2a8. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:32:33 user nova-compute[71516]: DEBUG nova.network.neutron [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updating instance_info_cache with network_info: [{"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:32:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] Releasing lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:32:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG os_brick.utils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e68628-a998-4196-8a28-b5bcea128384]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fad55a-8406-4d58-a57f-b60dd2fc8d5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e721ba-8ea3-4044-956a-16650ebbcdb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5afca6-6d17-43fc-8cb1-8282c9f25709]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:32:37 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:32:37 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33952c3-785b-47ef-b33b-be0c2d678b86]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG os_brick.utils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:32:37 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updating existing volume attachment record: 5f1954c0-cd3e-4982-be7b-2c4f12b089a7 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:32:41 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Creating image(s)
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Ensure instance console log exists: /opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Start _get_guest_xml network_info=[{"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTazKIRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16682788-70d1-400d-adc3-0518282c04fa', 'attached_at': '', 'detached_at': '', 'volume_id': '82cc234e-1331-4705-bd36-6d07edde3bff', 'serial': '82cc234e-1331-4705-bd36-6d07edde3bff'}, 'disk_bus': 'virtio', 'attachment_id': '5f1954c0-cd3e-4982-be7b-2c4f12b089a7', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:32:41 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:32:41 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTazKIRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:32:41 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:32:41 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:32:41 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee286ce-2d46-4e2c-93f4-0008d029a083]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:32:41 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7307f878-a272-44fe-952c-9806b0bdce2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff] added
Apr 11 23:32:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ca67a6-1999-4851-a3b0-caf773beccbf]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b75ad3b-91cd-42a8-a2b6-6c6d07d15726]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTazKIRG {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTazKIRG" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abf45e8-98cf-4429-9ecb-8800c244383b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cTazKIRG'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e54d54-3bab-42af-810f-6beb2016c736]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f8dfa2-fc0f-4517-859e-78b5cada5b9e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 23:32:41 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 23:32:41 user nova-compute[71516]:  {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:32:41 user nova-compute[71516]: WARNING os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 23:32:41 user nova-compute[71516]: 
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa4b716-8fe7-4afc-bf35-d2cc6fe61342]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff, portal: 172.16.0.220,3260]
Apr 11 23:32:41 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff, portal: 172.16.0.220,3260] successful.
Apr 11 23:32:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4678238c-0792-4638-acd2-5739a51b6c53]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc92867-14f4-4354-aed1-215e93eb7e35]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:32:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:32:41 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32a0ce3-6819-45be-94c9-07a677f72915]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:32:41 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTazKIRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26537313534633735', 'path': '/dev/sdb'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537313534633735', 'path': '/dev/sdb'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-965527401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-965527401',id=42,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-bcyh9nea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:32:32Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=16682788-70d1-400d-adc3-0518282c04fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=624afba1-f295-47d2-8419-91f51beeb2a8,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624afba1-f2') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG nova.objects.instance [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'pci_devices' on Instance uuid 16682788-70d1-400d-adc3-0518282c04fa {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:32:42 user nova-compute[71516]:   <uuid>16682788-70d1-400d-adc3-0518282c04fa</uuid>
Apr 11 23:32:42 user nova-compute[71516]:   <name>instance-0000002a</name>
Apr 11 23:32:42 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:32:42 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:32:42 user nova-compute[71516]:   <metadata>
Apr 11 23:32:42 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:32:42 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:32:42 user nova-compute[71516]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-965527401</nova:name>
Apr 11 23:32:42 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:32:41</nova:creationTime>
Apr 11 23:32:42 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:32:42 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:32:42 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:32:42 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:32:42 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:32:42 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:32:42 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:32:42 user nova-compute[71516]:       <nova:owner>
Apr 11 23:32:42 user nova-compute[71516]:         <nova:user uuid="34d0482650674249adb77724a287d53e">tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member</nova:user>
Apr 11 23:32:42 user nova-compute[71516]:         <nova:project uuid="5d1c7064a4f845d1b39a49795d00d9b0">tempest-ServerBootFromVolumeStableRescueTest-948037051</nova:project>
Apr 11 23:32:42 user nova-compute[71516]:       </nova:owner>
Apr 11 23:32:42 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:32:42 user nova-compute[71516]:       <nova:ports>
Apr 11 23:32:42 user nova-compute[71516]:         <nova:port uuid="624afba1-f295-47d2-8419-91f51beeb2a8">
Apr 11 23:32:42 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 23:32:42 user nova-compute[71516]:         </nova:port>
Apr 11 23:32:42 user nova-compute[71516]:       </nova:ports>
Apr 11 23:32:42 user nova-compute[71516]:     </nova:instance>
Apr 11 23:32:42 user nova-compute[71516]:   </metadata>
Apr 11 23:32:42 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:32:42 user nova-compute[71516]:     <system>
Apr 11 23:32:42 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:32:42 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:32:42 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:32:42 user nova-compute[71516]:       <entry name="serial">16682788-70d1-400d-adc3-0518282c04fa</entry>
Apr 11 23:32:42 user nova-compute[71516]:       <entry name="uuid">16682788-70d1-400d-adc3-0518282c04fa</entry>
Apr 11 23:32:42 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:32:42 user nova-compute[71516]:     </system>
Apr 11 23:32:42 user nova-compute[71516]:   </sysinfo>
Apr 11 23:32:42 user nova-compute[71516]:   <os>
Apr 11 23:32:42 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:32:42 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:32:42 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:32:42 user nova-compute[71516]:   </os>
Apr 11 23:32:42 user nova-compute[71516]:   <features>
Apr 11 23:32:42 user nova-compute[71516]:     <acpi/>
Apr 11 23:32:42 user nova-compute[71516]:     <apic/>
Apr 11 23:32:42 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:32:42 user nova-compute[71516]:   </features>
Apr 11 23:32:42 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:32:42 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:32:42 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:32:42 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:32:42 user nova-compute[71516]:   </clock>
Apr 11 23:32:42 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:32:42 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:32:42 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:32:42 user nova-compute[71516]:   </cpu>
Apr 11 23:32:42 user nova-compute[71516]:   <devices>
Apr 11 23:32:42 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:32:42 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:32:42 user nova-compute[71516]:       <source dev="/dev/sdb"/>
Apr 11 23:32:42 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:32:42 user nova-compute[71516]:       <serial>82cc234e-1331-4705-bd36-6d07edde3bff</serial>
Apr 11 23:32:42 user nova-compute[71516]:     </disk>
Apr 11 23:32:42 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:32:42 user nova-compute[71516]:       <mac address="fa:16:3e:e3:ba:da"/>
Apr 11 23:32:42 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:32:42 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:32:42 user nova-compute[71516]:       <target dev="tap624afba1-f2"/>
Apr 11 23:32:42 user nova-compute[71516]:     </interface>
Apr 11 23:32:42 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:32:42 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/console.log" append="off"/>
Apr 11 23:32:42 user nova-compute[71516]:     </serial>
Apr 11 23:32:42 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:32:42 user nova-compute[71516]:     <video>
Apr 11 23:32:42 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:32:42 user nova-compute[71516]:     </video>
Apr 11 23:32:42 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:32:42 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:32:42 user nova-compute[71516]:     </rng>
Apr 11 23:32:42 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:32:42 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:32:42 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:32:42 user nova-compute[71516]:     </memballoon>
Apr 11 23:32:42 user nova-compute[71516]:   </devices>
Apr 11 23:32:42 user nova-compute[71516]: </domain>
Apr 11 23:32:42 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-965527401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-965527401',id=42,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-bcyh9nea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:32:32Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=16682788-70d1-400d-adc3-0518282c04fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=624afba1-f295-47d2-8419-91f51beeb2a8,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624afba1-f2') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG os_vif [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=624afba1-f295-47d2-8419-91f51beeb2a8,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624afba1-f2') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap624afba1-f2, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap624afba1-f2, col_values=(('external_ids', {'iface-id': '624afba1-f295-47d2-8419-91f51beeb2a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:ba:da', 'vm-uuid': '16682788-70d1-400d-adc3-0518282c04fa'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:42 user nova-compute[71516]: INFO os_vif [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=624afba1-f295-47d2-8419-91f51beeb2a8,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624afba1-f2')
Apr 11 23:32:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:32:42 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No VIF found with MAC fa:16:3e:e3:ba:da, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:32:44 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:32:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-96d0817a-c6bc-4f37-8d32-9cd8aa91d65f req-9ce0e645-974f-4360-a6dc-98c07d3ce9b6 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:32:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96d0817a-c6bc-4f37-8d32-9cd8aa91d65f req-9ce0e645-974f-4360-a6dc-98c07d3ce9b6 service nova] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:32:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96d0817a-c6bc-4f37-8d32-9cd8aa91d65f req-9ce0e645-974f-4360-a6dc-98c07d3ce9b6 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:32:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-96d0817a-c6bc-4f37-8d32-9cd8aa91d65f req-9ce0e645-974f-4360-a6dc-98c07d3ce9b6 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:32:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-96d0817a-c6bc-4f37-8d32-9cd8aa91d65f req-9ce0e645-974f-4360-a6dc-98c07d3ce9b6 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] No waiting events found dispatching network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:32:44 user nova-compute[71516]: WARNING nova.compute.manager [req-96d0817a-c6bc-4f37-8d32-9cd8aa91d65f req-9ce0e645-974f-4360-a6dc-98c07d3ce9b6 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received unexpected event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 for instance with vm_state building and task_state spawning.
Apr 11 23:32:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255966.3206809, 16682788-70d1-400d-adc3-0518282c04fa => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:32:46 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] VM Resumed (Lifecycle Event)
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:32:46 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Instance spawned successfully.
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:32:46 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681255966.3222795, 16682788-70d1-400d-adc3-0518282c04fa => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:32:46 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] VM Started (Lifecycle Event)
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:32:46 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-857cdc65-6996-4e5d-9c41-45bf048ceb5c req-ad82bb15-8890-40e6-8b7b-17cf93523cbd service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-857cdc65-6996-4e5d-9c41-45bf048ceb5c req-ad82bb15-8890-40e6-8b7b-17cf93523cbd service nova] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-857cdc65-6996-4e5d-9c41-45bf048ceb5c req-ad82bb15-8890-40e6-8b7b-17cf93523cbd service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-857cdc65-6996-4e5d-9c41-45bf048ceb5c req-ad82bb15-8890-40e6-8b7b-17cf93523cbd service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-857cdc65-6996-4e5d-9c41-45bf048ceb5c req-ad82bb15-8890-40e6-8b7b-17cf93523cbd service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] No waiting events found dispatching network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:32:46 user nova-compute[71516]: WARNING nova.compute.manager [req-857cdc65-6996-4e5d-9c41-45bf048ceb5c req-ad82bb15-8890-40e6-8b7b-17cf93523cbd service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received unexpected event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 for instance with vm_state building and task_state spawning.
Apr 11 23:32:46 user nova-compute[71516]: INFO nova.compute.manager [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Took 4.91 seconds to spawn the instance on the hypervisor.
Apr 11 23:32:46 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:32:46 user nova-compute[71516]: INFO nova.compute.manager [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Took 15.35 seconds to build instance.
Apr 11 23:32:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "16682788-70d1-400d-adc3-0518282c04fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.446s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:32:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:48 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:32:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:32:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:32:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:32:48 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:32:48 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updating instance_info_cache with network_info: [{"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:32:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:32:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:32:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:32:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:32:51 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:32:52 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:32:52 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:32:52 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8653MB free_disk=26.171573638916016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:32:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:32:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:32:52 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:32:52 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:32:52 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:32:52 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:32:52 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:32:52 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:32:52 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:32:52 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:32:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:32:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:32:53 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:32:54 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:32:55 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:32:55 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:32:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:32:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:32:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:02 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:33:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:33:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:33:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:33:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:33:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:33:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:33:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:33:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:33:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:33:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:33:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:33:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:33:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:25 user nova-compute[71516]: DEBUG nova.compute.manager [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Received event network-changed-5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:33:25 user nova-compute[71516]: DEBUG nova.compute.manager [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Refreshing instance network info cache due to event network-changed-5b75ff13-136e-4805-9959-478fe1165c45. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:33:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] Acquiring lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:33:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] Acquired lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:33:25 user nova-compute[71516]: DEBUG nova.network.neutron [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Refreshing network info cache for port 5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:33:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:33:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:33:25 user nova-compute[71516]: DEBUG nova.objects.instance [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'flavor' on Instance uuid 6daabd9b-ed06-4bfc-a323-e464f5e29b3c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:33:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:33:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:33:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:33:25 user nova-compute[71516]: INFO nova.compute.manager [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Attaching volume a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 to /dev/vdb
Apr 11 23:33:25 user nova-compute[71516]: DEBUG os_brick.utils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:33:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4945f48-931e-430f-a01b-e7da877e7b17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b6b2cb-7eda-4408-a18f-f519d7ad9c10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3cd303-4ef3-46a0-a7c7-d4cdec045021]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[782fdfde-6d26-4e96-93cf-2d277985010f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:33:26 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e67f638-1adb-45f1-8672-6dcbbdcb8981]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG os_brick.utils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updating existing volume attachment record: 8ebc21bf-8f11-4384-875d-513720e3c0d0 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG nova.network.neutron [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updated VIF entry in instance network info cache for port 5b75ff13-136e-4805-9959-478fe1165c45. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG nova.network.neutron [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updating instance_info_cache with network_info: [{"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:33:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] Releasing lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:33:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghtkUuKP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:33:30 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:33:30 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:33:30 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0164aa79-3b31-4db6-af83-b77945c27184]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:33:30 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a133941-4dc9-4582-9a44-7093d89dd213]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4] added
Apr 11 23:33:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.055s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bab7bd-f8cf-4655-af1e-0e9d6b76482d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b232a079-9072-441b-8fe5-48071799d1db]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ghtkUuKP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ghtkUuKP" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[181c8d9d-96f6-499c-86d0-ad271b719eb6]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ghtkUuKP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ebeb53-aaf9-4991-8535-49050e4fb22e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[73403349-968a-4632-837e-357a0a3c289b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:33:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:33:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ded2eb4-64b6-46cc-ba98-a852c1582963]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4, portal: 172.16.0.220,3260]
Apr 11 23:33:30 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4, portal: 172.16.0.220,3260] successful.
Apr 11 23:33:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06c5b15-5890-4731-a897-887b59e709ea]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1582d20-8ec1-4381-8df0-e2bfe8a05268]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:33:30 user nova-compute[71516]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 (non-flash)
Apr 11 23:33:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:33:30 user nova-compute[71516]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 (non-flash)
Apr 11 23:33:30 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dd8ec1-3487-4b4f-9e8e-60964d77b4a3]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:30 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:33:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:31 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:33:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghtkUuKP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:33:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:33:31 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26336333961393639', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:33:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336333961393639', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:33:31 user nova-compute[71516]: DEBUG nova.objects.instance [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'flavor' on Instance uuid 6daabd9b-ed06-4bfc-a323-e464f5e29b3c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:33:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:33:31 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:33:31 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:33:31 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:33:31 user nova-compute[71516]:   <serial>a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4</serial>
Apr 11 23:33:31 user nova-compute[71516]: </disk>
Apr 11 23:33:31 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:33:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:33:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:33:31 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] No VIF found with MAC fa:16:3e:ab:bc:44, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:33:31 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.059s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:33:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:33:33 user nova-compute[71516]: INFO nova.compute.manager [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Detaching volume a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4
Apr 11 23:33:33 user nova-compute[71516]: INFO nova.virt.block_device [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Attempting to driver detach volume a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 from mountpoint /dev/vdb
Apr 11 23:33:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Attempting to detach device vdb from instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:33:33 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:33:33 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:33:33 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:33:33 user nova-compute[71516]:   <serial>a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4</serial>
Apr 11 23:33:33 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:33:33 user nova-compute[71516]: </disk>
Apr 11 23:33:33 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:33:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Successfully detached device vdb from instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c from the persistent domain config.
Apr 11 23:33:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:33:33 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:33:33 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:33:33 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:33:33 user nova-compute[71516]:   <serial>a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4</serial>
Apr 11 23:33:33 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:33:33 user nova-compute[71516]: </disk>
Apr 11 23:33:33 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681256013.9614816, 6daabd9b-ed06-4bfc-a323-e464f5e29b3c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:33:33 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Successfully detached device vdb from instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c from the live domain config.
Apr 11 23:33:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghtkUuKP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:33:33 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:33:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[93252414-124e-4ced-9ea1-404d4ae84105]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:33:33 user nova-compute[71516]: No targets found.
Apr 11 23:33:33 user nova-compute[71516]: iSNS:
Apr 11 23:33:33 user nova-compute[71516]: No targets found.
Apr 11 23:33:33 user nova-compute[71516]: STATIC:
Apr 11 23:33:33 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4
Apr 11 23:33:33 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:33:33 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:33:33 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff
Apr 11 23:33:33 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:33:33 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:33:33 user nova-compute[71516]: FIRMWARE:
Apr 11 23:33:33 user nova-compute[71516]: No targets found.
Apr 11 23:33:33 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:33:33 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:33:33 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:33:33 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceafdec5-979c-44df-b68b-bca64483f720]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ff7015-4376-42ba-9ebe-a5e56e75e87d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:33:34 user nova-compute[71516]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 (non-flash)
Apr 11 23:33:34 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:33:34 user nova-compute[71516]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 (non-flash)
Apr 11 23:33:34 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e5fd485e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[33330dad-8f46-4dc6-9470-24682992e3fb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ffecab-dbd0-4219-bcde-7c8b25193adc]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[962e6a4e-6909-407a-8f85-fd7dadc1e138]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a6ceb6-b407-468f-9ded-8b260bdd822a]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb081b10-5b01-4fdc-9045-471de523de6c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b605a48-c59b-48db-a32f-629ec4b86cb7]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4, portal: 172.16.0.220,3260]
Apr 11 23:33:34 user nova-compute[71516]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4, portal: 172.16.0.220,3260] successful.
Apr 11 23:33:34 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[63374250-7c20-46ba-9a2b-89f90e8b1024]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] <== disconnect_volume: return (274ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:33:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:33:35 user nova-compute[71516]: DEBUG nova.objects.instance [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'flavor' on Instance uuid 6daabd9b-ed06-4bfc-a323-e464f5e29b3c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:33:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.570s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:33:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:44 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:33:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:33:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:33:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:33:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:33:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:33:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:49 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:33:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:33:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:33:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:33:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:33:49 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:33:49 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid cd42372d-ba80-46bb-8ebb-712e6941d62b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:33:49 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updating instance_info_cache with network_info: [{"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:33:49 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:33:49 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:33:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:33:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:33:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:33:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:33:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:53 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:33:53 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:33:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8659MB free_disk=26.170513153076172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:33:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:33:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:33:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:33:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:33:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:33:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:33:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:33:53 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:33:53 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:33:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:33:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:33:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:33:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:33:57 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:33:57 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:33:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:03 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:34:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:34:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:34:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:34:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:34:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:34:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:34:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:34:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:34:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:34:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:21 user nova-compute[71516]: INFO nova.compute.manager [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Rescuing
Apr 11 23:34:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:34:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquired lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:34:21 user nova-compute[71516]: DEBUG nova.network.neutron [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:34:22 user nova-compute[71516]: DEBUG nova.network.neutron [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updating instance_info_cache with network_info: [{"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:34:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Releasing lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:34:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-9f9f781f-7bf0-447f-a216-a13aa2350c8b req-e3df55e7-848b-47b1-8128-c42e5e2ae48a service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-unplugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:34:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9f9f781f-7bf0-447f-a216-a13aa2350c8b req-e3df55e7-848b-47b1-8128-c42e5e2ae48a service nova] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9f9f781f-7bf0-447f-a216-a13aa2350c8b req-e3df55e7-848b-47b1-8128-c42e5e2ae48a service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9f9f781f-7bf0-447f-a216-a13aa2350c8b req-e3df55e7-848b-47b1-8128-c42e5e2ae48a service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-9f9f781f-7bf0-447f-a216-a13aa2350c8b req-e3df55e7-848b-47b1-8128-c42e5e2ae48a service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] No waiting events found dispatching network-vif-unplugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:34:22 user nova-compute[71516]: WARNING nova.compute.manager [req-9f9f781f-7bf0-447f-a216-a13aa2350c8b req-e3df55e7-848b-47b1-8128-c42e5e2ae48a service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received unexpected event network-vif-unplugged-624afba1-f295-47d2-8419-91f51beeb2a8 for instance with vm_state active and task_state rescuing.
Apr 11 23:34:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:23 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Instance destroyed successfully.
Apr 11 23:34:23 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Attempting a stable device rescue
Apr 11 23:34:23 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71516) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 23:34:23 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Instance directory exists: not creating {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 23:34:23 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Creating image(s)
Apr 11 23:34:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "/opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "/opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "/opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:23 user nova-compute[71516]: DEBUG nova.objects.instance [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16682788-70d1-400d-adc3-0518282c04fa {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:34:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "278fff86670c4eeaa23c25792349ab448cfe7aea" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "278fff86670c4eeaa23c25792349ab448cfe7aea" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea.part --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea.part --force-share --output=json" returned: 0 in 0.156s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG nova.virt.images [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 423d8b6d-f031-4f06-9bff-cc34e289190e was qcow2, converting to raw {{(pid=71516) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea.part /opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea.converted {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea.part /opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea.converted" returned: 0 in 0.413s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea.converted --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-e14fabb0-71d1-49dd-9002-3bde681e7929 req-2832fbd5-a6d0-481d-9f1a-bea9d38100a7 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e14fabb0-71d1-49dd-9002-3bde681e7929 req-2832fbd5-a6d0-481d-9f1a-bea9d38100a7 service nova] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e14fabb0-71d1-49dd-9002-3bde681e7929 req-2832fbd5-a6d0-481d-9f1a-bea9d38100a7 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e14fabb0-71d1-49dd-9002-3bde681e7929 req-2832fbd5-a6d0-481d-9f1a-bea9d38100a7 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG nova.compute.manager [req-e14fabb0-71d1-49dd-9002-3bde681e7929 req-2832fbd5-a6d0-481d-9f1a-bea9d38100a7 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] No waiting events found dispatching network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:34:24 user nova-compute[71516]: WARNING nova.compute.manager [req-e14fabb0-71d1-49dd-9002-3bde681e7929 req-2832fbd5-a6d0-481d-9f1a-bea9d38100a7 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received unexpected event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 for instance with vm_state active and task_state rescuing.
Apr 11 23:34:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "278fff86670c4eeaa23c25792349ab448cfe7aea" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.515s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "278fff86670c4eeaa23c25792349ab448cfe7aea" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "278fff86670c4eeaa23c25792349ab448cfe7aea" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:24 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea --force-share --output=json" returned: 0 in 0.130s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea,backing_fmt=raw /opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.rescue {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea,backing_fmt=raw /opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.rescue" returned: 0 in 0.052s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "278fff86670c4eeaa23c25792349ab448cfe7aea" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.objects.instance [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'migration_context' on Instance uuid 16682788-70d1-400d-adc3-0518282c04fa {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Start _get_guest_xml network_info=[{"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "vif_mac": "fa:16:3e:e3:ba:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '423d8b6d-f031-4f06-9bff-cc34e289190e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTazKIRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '16682788-70d1-400d-adc3-0518282c04fa', 'attached_at': '', 'detached_at': '', 'volume_id': '82cc234e-1331-4705-bd36-6d07edde3bff', 'serial': '82cc234e-1331-4705-bd36-6d07edde3bff'}, 'disk_bus': 'virtio', 'attachment_id': '5f1954c0-cd3e-4982-be7b-2c4f12b089a7', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.objects.instance [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'resources' on Instance uuid 16682788-70d1-400d-adc3-0518282c04fa {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.objects.instance [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'numa_topology' on Instance uuid 16682788-70d1-400d-adc3-0518282c04fa {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:34:25 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:34:25 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.objects.instance [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16682788-70d1-400d-adc3-0518282c04fa {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTazKIRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:34:25 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:34:25 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:34:25 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[412af721-46ca-4f89-a761-803c98e35183]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cTazKIRG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 23:34:25 user nova-compute[71516]: node.name = iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff
Apr 11 23:34:25 user nova-compute[71516]: node.tpgt = -1
Apr 11 23:34:25 user nova-compute[71516]: node.startup = automatic
Apr 11 23:34:25 user nova-compute[71516]: node.leading_login = No
Apr 11 23:34:25 user nova-compute[71516]: iface.iscsi_ifacename = default
Apr 11 23:34:25 user nova-compute[71516]: iface.net_ifacename = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.ipaddress = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.prefix_len = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.hwaddress = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.transport_name = tcp
Apr 11 23:34:25 user nova-compute[71516]: iface.initiatorname = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.state = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.vlan_id = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.vlan_priority = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.vlan_state = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.iface_num = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.mtu = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.port = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.bootproto = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.subnet_mask = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.gateway = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.dhcp_alt_client_id = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.dhcp_dns = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.dhcp_learn_iqn = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.dhcp_vendor_id_state = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.dhcp_vendor_id = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.dhcp_slp_da = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.fragmentation = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.gratuitous_arp = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.incoming_forwarding = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.tos_state = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.tos = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.ttl = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.delayed_ack = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.tcp_nagle = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.tcp_wsf_state = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.tcp_wsf = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.tcp_timer_scale = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.tcp_timestamp = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.redirect = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.def_task_mgmt_timeout = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.header_digest = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.data_digest = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.immediate_data = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.initial_r2t = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.data_seq_inorder = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.data_pdu_inorder = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.erl = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.max_receive_data_len = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.first_burst_len = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.max_outstanding_r2t = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.max_burst_len = 0
Apr 11 23:34:25 user nova-compute[71516]: iface.chap_auth = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.bidi_chap = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.strict_login_compliance = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.discovery_auth = <empty>
Apr 11 23:34:25 user nova-compute[71516]: iface.discovery_logout = <empty>
Apr 11 23:34:25 user nova-compute[71516]: node.discovery_address = <empty>
Apr 11 23:34:25 user nova-compute[71516]: node.discovery_port = 0
Apr 11 23:34:25 user nova-compute[71516]: node.discovery_type = static
Apr 11 23:34:25 user nova-compute[71516]: node.session.initial_cmdsn = 0
Apr 11 23:34:25 user nova-compute[71516]: node.session.initial_login_retry_max = 8
Apr 11 23:34:25 user nova-compute[71516]: node.session.xmit_thread_priority = -20
Apr 11 23:34:25 user nova-compute[71516]: node.session.cmds_max = 128
Apr 11 23:34:25 user nova-compute[71516]: node.session.queue_depth = 32
Apr 11 23:34:25 user nova-compute[71516]: node.session.nr_sessions = 1
Apr 11 23:34:25 user nova-compute[71516]: node.session.auth.authmethod = CHAP
Apr 11 23:34:25 user nova-compute[71516]: node.session.auth.username = cTazKIRG
Apr 11 23:34:25 user nova-compute[71516]: node.session.auth.password = ***
Apr 11 23:34:25 user nova-compute[71516]: node.session.auth.username_in = <empty>
Apr 11 23:34:25 user nova-compute[71516]: node.session.auth.password_in = <empty>
Apr 11 23:34:25 user nova-compute[71516]: node.session.auth.chap_algs = MD5
Apr 11 23:34:25 user nova-compute[71516]: node.session.timeo.replacement_timeout = 120
Apr 11 23:34:25 user nova-compute[71516]: node.session.err_timeo.abort_timeout = 15
Apr 11 23:34:25 user nova-compute[71516]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 23:34:25 user nova-compute[71516]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 23:34:25 user nova-compute[71516]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 23:34:25 user nova-compute[71516]: node.session.iscsi.FastAbort = Yes
Apr 11 23:34:25 user nova-compute[71516]: node.session.iscsi.InitialR2T = No
Apr 11 23:34:25 user nova-compute[71516]: node.session.iscsi.ImmediateData = Yes
Apr 11 23:34:25 user nova-compute[71516]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 23:34:25 user nova-compute[71516]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 23:34:25 user nova-compute[71516]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 23:34:25 user nova-compute[71516]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 23:34:25 user nova-compute[71516]: node.session.iscsi.MaxConnections = 1
Apr 11 23:34:25 user nova-compute[71516]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 23:34:25 user nova-compute[71516]: node.session.iscsi.ERL = 0
Apr 11 23:34:25 user nova-compute[71516]: node.session.scan = manual
Apr 11 23:34:25 user nova-compute[71516]: node.session.reopen_max = 0
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].address = 172.16.0.220
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].port = 3260
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].startup = manual
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].tcp.window_size = 524288
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].tcp.type_of_service = 0
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].timeo.logout_timeout = 15
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].timeo.login_timeout = 15
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].timeo.auth_timeout = 45
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].iscsi.DataDigest = None
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].iscsi.IFMarker = No
Apr 11 23:34:25 user nova-compute[71516]: node.conn[0].iscsi.OFMarker = No
Apr 11 23:34:25 user nova-compute[71516]: # END RECORD
Apr 11 23:34:25 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a60687b-20c3-4158-997d-542649fade03]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c118a246-a5e4-49ad-8918-4cc62f871874]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTazKIRG {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTazKIRG" returned: 0 in 0.035s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e80af9-4e8d-4e68-8f6d-9336daeccd8a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cTazKIRG'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6c1312-aedb-46ec-9420-885868a979d7]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ef3abe-534b-44cd-b91a-d77b5bfc9c86]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:34:25 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:34:25 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] HCTL ('33', '0', '0', 0) found on session 50 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0337ae68-6027-4f0d-92d7-8f2a1b3ddc60]: (4, ('0 0 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Searching for a device in session 50 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTazKIRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '26537313534633735', 'path': '/dev/sdb'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537313534633735', 'path': '/dev/sdb'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-965527401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-965527401',id=42,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:32:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-bcyh9nea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:32:46Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=16682788-70d1-400d-adc3-0518282c04fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "vif_mac": "fa:16:3e:e3:ba:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "vif_mac": "fa:16:3e:e3:ba:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=624afba1-f295-47d2-8419-91f51beeb2a8,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624afba1-f2') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.objects.instance [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'pci_devices' on Instance uuid 16682788-70d1-400d-adc3-0518282c04fa {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:34:25 user nova-compute[71516]:   <uuid>16682788-70d1-400d-adc3-0518282c04fa</uuid>
Apr 11 23:34:25 user nova-compute[71516]:   <name>instance-0000002a</name>
Apr 11 23:34:25 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:34:25 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:34:25 user nova-compute[71516]:   <metadata>
Apr 11 23:34:25 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:34:25 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:34:25 user nova-compute[71516]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-965527401</nova:name>
Apr 11 23:34:25 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:34:25</nova:creationTime>
Apr 11 23:34:25 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:34:25 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:34:25 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:34:25 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:34:25 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:34:25 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:34:25 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:34:25 user nova-compute[71516]:       <nova:owner>
Apr 11 23:34:25 user nova-compute[71516]:         <nova:user uuid="34d0482650674249adb77724a287d53e">tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member</nova:user>
Apr 11 23:34:25 user nova-compute[71516]:         <nova:project uuid="5d1c7064a4f845d1b39a49795d00d9b0">tempest-ServerBootFromVolumeStableRescueTest-948037051</nova:project>
Apr 11 23:34:25 user nova-compute[71516]:       </nova:owner>
Apr 11 23:34:25 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:34:25 user nova-compute[71516]:       <nova:ports>
Apr 11 23:34:25 user nova-compute[71516]:         <nova:port uuid="624afba1-f295-47d2-8419-91f51beeb2a8">
Apr 11 23:34:25 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 23:34:25 user nova-compute[71516]:         </nova:port>
Apr 11 23:34:25 user nova-compute[71516]:       </nova:ports>
Apr 11 23:34:25 user nova-compute[71516]:     </nova:instance>
Apr 11 23:34:25 user nova-compute[71516]:   </metadata>
Apr 11 23:34:25 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:34:25 user nova-compute[71516]:     <system>
Apr 11 23:34:25 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:34:25 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:34:25 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:34:25 user nova-compute[71516]:       <entry name="serial">16682788-70d1-400d-adc3-0518282c04fa</entry>
Apr 11 23:34:25 user nova-compute[71516]:       <entry name="uuid">16682788-70d1-400d-adc3-0518282c04fa</entry>
Apr 11 23:34:25 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:34:25 user nova-compute[71516]:     </system>
Apr 11 23:34:25 user nova-compute[71516]:   </sysinfo>
Apr 11 23:34:25 user nova-compute[71516]:   <os>
Apr 11 23:34:25 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:34:25 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:34:25 user nova-compute[71516]:   </os>
Apr 11 23:34:25 user nova-compute[71516]:   <features>
Apr 11 23:34:25 user nova-compute[71516]:     <acpi/>
Apr 11 23:34:25 user nova-compute[71516]:     <apic/>
Apr 11 23:34:25 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:34:25 user nova-compute[71516]:   </features>
Apr 11 23:34:25 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:34:25 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:34:25 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:34:25 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:34:25 user nova-compute[71516]:   </clock>
Apr 11 23:34:25 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:34:25 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:34:25 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:34:25 user nova-compute[71516]:   </cpu>
Apr 11 23:34:25 user nova-compute[71516]:   <devices>
Apr 11 23:34:25 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:34:25 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:34:25 user nova-compute[71516]:       <source dev="/dev/sdb"/>
Apr 11 23:34:25 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:34:25 user nova-compute[71516]:       <serial>82cc234e-1331-4705-bd36-6d07edde3bff</serial>
Apr 11 23:34:25 user nova-compute[71516]:     </disk>
Apr 11 23:34:25 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:34:25 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:34:25 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.rescue"/>
Apr 11 23:34:25 user nova-compute[71516]:       <target dev="vdb" bus="virtio"/>
Apr 11 23:34:25 user nova-compute[71516]:       <boot order="1"/>
Apr 11 23:34:25 user nova-compute[71516]:     </disk>
Apr 11 23:34:25 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:34:25 user nova-compute[71516]:       <mac address="fa:16:3e:e3:ba:da"/>
Apr 11 23:34:25 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:34:25 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:34:25 user nova-compute[71516]:       <target dev="tap624afba1-f2"/>
Apr 11 23:34:25 user nova-compute[71516]:     </interface>
Apr 11 23:34:25 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:34:25 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/console.log" append="off"/>
Apr 11 23:34:25 user nova-compute[71516]:     </serial>
Apr 11 23:34:25 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:34:25 user nova-compute[71516]:     <video>
Apr 11 23:34:25 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:34:25 user nova-compute[71516]:     </video>
Apr 11 23:34:25 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:34:25 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:34:25 user nova-compute[71516]:     </rng>
Apr 11 23:34:25 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:34:25 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:34:25 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:34:25 user nova-compute[71516]:     </memballoon>
Apr 11 23:34:25 user nova-compute[71516]:   </devices>
Apr 11 23:34:25 user nova-compute[71516]: </domain>
Apr 11 23:34:25 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:34:25 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Instance destroyed successfully.
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No VIF found with MAC fa:16:3e:e3:ba:da, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:34:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:34:26 user nova-compute[71516]: INFO nova.compute.manager [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] instance snapshotting
Apr 11 23:34:26 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Beginning live snapshot process
Apr 11 23:34:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json -f qcow2 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json -f qcow2 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json -f qcow2" returned: 0 in 0.150s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5ejx24v7/8338331f73864088926bc6483d400f6b.delta 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:26 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5ejx24v7/8338331f73864088926bc6483d400f6b.delta 1073741824" returned: 0 in 0.048s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:26 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 23:34:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:27 user nova-compute[71516]: DEBUG nova.compute.manager [req-606d1f90-cf01-4bd1-8fd4-388b217eca01 req-78bc32a6-2a82-419e-bac5-7c80c017af71 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:34:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-606d1f90-cf01-4bd1-8fd4-388b217eca01 req-78bc32a6-2a82-419e-bac5-7c80c017af71 service nova] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-606d1f90-cf01-4bd1-8fd4-388b217eca01 req-78bc32a6-2a82-419e-bac5-7c80c017af71 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-606d1f90-cf01-4bd1-8fd4-388b217eca01 req-78bc32a6-2a82-419e-bac5-7c80c017af71 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:27 user nova-compute[71516]: DEBUG nova.compute.manager [req-606d1f90-cf01-4bd1-8fd4-388b217eca01 req-78bc32a6-2a82-419e-bac5-7c80c017af71 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] No waiting events found dispatching network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:34:27 user nova-compute[71516]: WARNING nova.compute.manager [req-606d1f90-cf01-4bd1-8fd4-388b217eca01 req-78bc32a6-2a82-419e-bac5-7c80c017af71 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received unexpected event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 for instance with vm_state active and task_state rescuing.
Apr 11 23:34:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:27 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:34:27 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:34:27 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 23:34:28 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:34:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5ejx24v7/8338331f73864088926bc6483d400f6b.delta /opt/stack/data/nova/instances/snapshots/tmp5ejx24v7/8338331f73864088926bc6483d400f6b {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:28 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5ejx24v7/8338331f73864088926bc6483d400f6b.delta /opt/stack/data/nova/instances/snapshots/tmp5ejx24v7/8338331f73864088926bc6483d400f6b" returned: 0 in 0.402s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:28 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Snapshot extracted, beginning image upload
Apr 11 23:34:29 user nova-compute[71516]: DEBUG nova.compute.manager [req-e36fbab8-815f-42db-b58c-148d59170ab8 req-3cc2a62b-e3f9-4f92-a577-ade45891f499 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:34:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e36fbab8-815f-42db-b58c-148d59170ab8 req-3cc2a62b-e3f9-4f92-a577-ade45891f499 service nova] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e36fbab8-815f-42db-b58c-148d59170ab8 req-3cc2a62b-e3f9-4f92-a577-ade45891f499 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:29 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e36fbab8-815f-42db-b58c-148d59170ab8 req-3cc2a62b-e3f9-4f92-a577-ade45891f499 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:29 user nova-compute[71516]: DEBUG nova.compute.manager [req-e36fbab8-815f-42db-b58c-148d59170ab8 req-3cc2a62b-e3f9-4f92-a577-ade45891f499 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] No waiting events found dispatching network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:34:29 user nova-compute[71516]: WARNING nova.compute.manager [req-e36fbab8-815f-42db-b58c-148d59170ab8 req-3cc2a62b-e3f9-4f92-a577-ade45891f499 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received unexpected event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 for instance with vm_state active and task_state rescuing.
Apr 11 23:34:29 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for 16682788-70d1-400d-adc3-0518282c04fa due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:34:29 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256069.459127, 16682788-70d1-400d-adc3-0518282c04fa => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:34:29 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] VM Resumed (Lifecycle Event)
Apr 11 23:34:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:34:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:34:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:34:29 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 23:34:29 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256069.4597926, 16682788-70d1-400d-adc3-0518282c04fa => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:34:29 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] VM Started (Lifecycle Event)
Apr 11 23:34:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:34:29 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:34:30 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Snapshot image upload complete
Apr 11 23:34:30 user nova-compute[71516]: INFO nova.compute.manager [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Took 4.61 seconds to snapshot the instance on the hypervisor.
Apr 11 23:34:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "ae9134ec-5953-49ad-b32f-a00a6310e497" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:34:34 user nova-compute[71516]: INFO nova.compute.claims [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Claim successful on node user
Apr 11 23:34:34 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG nova.network.neutron [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:34:34 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:34:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG nova.policy [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fba33ae43c34bbba115df1e892b2034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bef1ddbef124fff82634357a1db9594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:34:34 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Creating image(s)
Apr 11 23:34:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "/opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "/opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "5e279861008d085bb712b2ee5817ed99a6f9d949" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "5e279861008d085bb712b2ee5817ed99a6f9d949" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949.part --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG nova.network.neutron [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Successfully created port: 619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949.part --force-share --output=json" returned: 0 in 0.151s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG nova.virt.images [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 74c41659-7d9e-414c-bd94-94665c6dd7f1 was qcow2, converting to raw {{(pid=71516) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949.part /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949.converted {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949.part /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949.converted" returned: 0 in 0.183s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949.converted --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "5e279861008d085bb712b2ee5817ed99a6f9d949" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.095s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949 --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "5e279861008d085bb712b2ee5817ed99a6f9d949" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "5e279861008d085bb712b2ee5817ed99a6f9d949" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949 --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949,backing_fmt=raw /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949,backing_fmt=raw /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk 1073741824" returned: 0 in 0.048s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "5e279861008d085bb712b2ee5817ed99a6f9d949" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG nova.network.neutron [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Successfully updated port: 619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Received event network-changed-619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Refreshing instance network info cache due to event network-changed-619a3191-9b7d-437b-bfd8-e03d80e4eddf. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] Acquiring lock "refresh_cache-ae9134ec-5953-49ad-b32f-a00a6310e497" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] Acquired lock "refresh_cache-ae9134ec-5953-49ad-b32f-a00a6310e497" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Refreshing network info cache for port 619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "refresh_cache-ae9134ec-5953-49ad-b32f-a00a6310e497" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949 --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG nova.objects.instance [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'migration_context' on Instance uuid ae9134ec-5953-49ad-b32f-a00a6310e497 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Ensure instance console log exists: /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG nova.network.neutron [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] Releasing lock "refresh_cache-ae9134ec-5953-49ad-b32f-a00a6310e497" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquired lock "refresh_cache-ae9134ec-5953-49ad-b32f-a00a6310e497" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG nova.network.neutron [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:34:36 user nova-compute[71516]: DEBUG nova.network.neutron [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.network.neutron [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Updating instance_info_cache with network_info: [{"id": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "address": "fa:16:3e:a9:b3:cd", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a3191-9b", "ovs_interfaceid": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Releasing lock "refresh_cache-ae9134ec-5953-49ad-b32f-a00a6310e497" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Instance network_info: |[{"id": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "address": "fa:16:3e:a9:b3:cd", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a3191-9b", "ovs_interfaceid": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Start _get_guest_xml network_info=[{"id": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "address": "fa:16:3e:a9:b3:cd", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a3191-9b", "ovs_interfaceid": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='40d750ad339e32b4bad6d6e4ef7d6dfa',container_format='bare',created_at=2023-04-11T23:34:26Z,direct_url=<?>,disk_format='qcow2',id=74c41659-7d9e-414c-bd94-94665c6dd7f1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-141295392',owner='6bef1ddbef124fff82634357a1db9594',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T23:34:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '74c41659-7d9e-414c-bd94-94665c6dd7f1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:34:37 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:34:37 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='40d750ad339e32b4bad6d6e4ef7d6dfa',container_format='bare',created_at=2023-04-11T23:34:26Z,direct_url=<?>,disk_format='qcow2',id=74c41659-7d9e-414c-bd94-94665c6dd7f1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-141295392',owner='6bef1ddbef124fff82634357a1db9594',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T23:34:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1459997543',display_name='tempest-TestStampPattern-server-1459997543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1459997543',id=43,image_ref='74c41659-7d9e-414c-bd94-94665c6dd7f1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDPm4ZPOCf1l7GfxihjBWYCbrccfGFsoS4jnE01iprxBmAib6g39KNKImt4ZLVsCOh1eFL88paYMZusOg3ArGPCcKgWAPxJaKEnhN2keDRL16gSTkvFeR2q1Q375pTqdw==',key_name='tempest-TestStampPattern-718348001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bef1ddbef124fff82634357a1db9594',ramdisk_id='',reservation_id='r-1qr6n27f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6daabd9b-ed06-4bfc-a323-e464f5e29b3c',image_min_disk='1',image_min_ram='0',image_owner_id='6bef1ddbef124fff82634357a1db9594',image_owner_project_name='tempest-TestStampPattern-1577365278',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1577365278-project-member',image_user_id='3fba33ae43c34bbba115df1e892b2034',network_allocated='True',owner_project_name='tempest-TestStampPattern-1577365278',owner_user_name='tempest-TestStampPattern-1577365278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:34:35Z,user_data=None,user_id='3fba33ae43c34bbba115df1e892b2034',uuid=ae9134ec-5953-49ad-b32f-a00a6310e497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "address": "fa:16:3e:a9:b3:cd", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a3191-9b", "ovs_interfaceid": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Converting VIF {"id": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "address": "fa:16:3e:a9:b3:cd", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a3191-9b", "ovs_interfaceid": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b3:cd,bridge_name='br-int',has_traffic_filtering=True,id=619a3191-9b7d-437b-bfd8-e03d80e4eddf,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a3191-9b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.objects.instance [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'pci_devices' on Instance uuid ae9134ec-5953-49ad-b32f-a00a6310e497 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:34:37 user nova-compute[71516]:   <uuid>ae9134ec-5953-49ad-b32f-a00a6310e497</uuid>
Apr 11 23:34:37 user nova-compute[71516]:   <name>instance-0000002b</name>
Apr 11 23:34:37 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:34:37 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:34:37 user nova-compute[71516]:   <metadata>
Apr 11 23:34:37 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:34:37 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:34:37 user nova-compute[71516]:       <nova:name>tempest-TestStampPattern-server-1459997543</nova:name>
Apr 11 23:34:37 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:34:37</nova:creationTime>
Apr 11 23:34:37 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:34:37 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:34:37 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:34:37 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:34:37 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:34:37 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:34:37 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:34:37 user nova-compute[71516]:       <nova:owner>
Apr 11 23:34:37 user nova-compute[71516]:         <nova:user uuid="3fba33ae43c34bbba115df1e892b2034">tempest-TestStampPattern-1577365278-project-member</nova:user>
Apr 11 23:34:37 user nova-compute[71516]:         <nova:project uuid="6bef1ddbef124fff82634357a1db9594">tempest-TestStampPattern-1577365278</nova:project>
Apr 11 23:34:37 user nova-compute[71516]:       </nova:owner>
Apr 11 23:34:37 user nova-compute[71516]:       <nova:root type="image" uuid="74c41659-7d9e-414c-bd94-94665c6dd7f1"/>
Apr 11 23:34:37 user nova-compute[71516]:       <nova:ports>
Apr 11 23:34:37 user nova-compute[71516]:         <nova:port uuid="619a3191-9b7d-437b-bfd8-e03d80e4eddf">
Apr 11 23:34:37 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 23:34:37 user nova-compute[71516]:         </nova:port>
Apr 11 23:34:37 user nova-compute[71516]:       </nova:ports>
Apr 11 23:34:37 user nova-compute[71516]:     </nova:instance>
Apr 11 23:34:37 user nova-compute[71516]:   </metadata>
Apr 11 23:34:37 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:34:37 user nova-compute[71516]:     <system>
Apr 11 23:34:37 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:34:37 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:34:37 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:34:37 user nova-compute[71516]:       <entry name="serial">ae9134ec-5953-49ad-b32f-a00a6310e497</entry>
Apr 11 23:34:37 user nova-compute[71516]:       <entry name="uuid">ae9134ec-5953-49ad-b32f-a00a6310e497</entry>
Apr 11 23:34:37 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:34:37 user nova-compute[71516]:     </system>
Apr 11 23:34:37 user nova-compute[71516]:   </sysinfo>
Apr 11 23:34:37 user nova-compute[71516]:   <os>
Apr 11 23:34:37 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:34:37 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:34:37 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:34:37 user nova-compute[71516]:   </os>
Apr 11 23:34:37 user nova-compute[71516]:   <features>
Apr 11 23:34:37 user nova-compute[71516]:     <acpi/>
Apr 11 23:34:37 user nova-compute[71516]:     <apic/>
Apr 11 23:34:37 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:34:37 user nova-compute[71516]:   </features>
Apr 11 23:34:37 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:34:37 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:34:37 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:34:37 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:34:37 user nova-compute[71516]:   </clock>
Apr 11 23:34:37 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:34:37 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:34:37 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:34:37 user nova-compute[71516]:   </cpu>
Apr 11 23:34:37 user nova-compute[71516]:   <devices>
Apr 11 23:34:37 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:34:37 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:34:37 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk"/>
Apr 11 23:34:37 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:34:37 user nova-compute[71516]:     </disk>
Apr 11 23:34:37 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:34:37 user nova-compute[71516]:       <mac address="fa:16:3e:a9:b3:cd"/>
Apr 11 23:34:37 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:34:37 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:34:37 user nova-compute[71516]:       <target dev="tap619a3191-9b"/>
Apr 11 23:34:37 user nova-compute[71516]:     </interface>
Apr 11 23:34:37 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:34:37 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/console.log" append="off"/>
Apr 11 23:34:37 user nova-compute[71516]:     </serial>
Apr 11 23:34:37 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:34:37 user nova-compute[71516]:     <video>
Apr 11 23:34:37 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:34:37 user nova-compute[71516]:     </video>
Apr 11 23:34:37 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:34:37 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:34:37 user nova-compute[71516]:     </rng>
Apr 11 23:34:37 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:34:37 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:34:37 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:34:37 user nova-compute[71516]:     </memballoon>
Apr 11 23:34:37 user nova-compute[71516]:   </devices>
Apr 11 23:34:37 user nova-compute[71516]: </domain>
Apr 11 23:34:37 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1459997543',display_name='tempest-TestStampPattern-server-1459997543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1459997543',id=43,image_ref='74c41659-7d9e-414c-bd94-94665c6dd7f1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDPm4ZPOCf1l7GfxihjBWYCbrccfGFsoS4jnE01iprxBmAib6g39KNKImt4ZLVsCOh1eFL88paYMZusOg3ArGPCcKgWAPxJaKEnhN2keDRL16gSTkvFeR2q1Q375pTqdw==',key_name='tempest-TestStampPattern-718348001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bef1ddbef124fff82634357a1db9594',ramdisk_id='',reservation_id='r-1qr6n27f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6daabd9b-ed06-4bfc-a323-e464f5e29b3c',image_min_disk='1',image_min_ram='0',image_owner_id='6bef1ddbef124fff82634357a1db9594',image_owner_project_name='tempest-TestStampPattern-1577365278',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1577365278-project-member',image_user_id='3fba33ae43c34bbba115df1e892b2034',network_allocated='True',owner_project_name='tempest-TestStampPattern-1577365278',owner_user_name='tempest-TestStampPattern-1577365278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:34:35Z,user_data=None,user_id='3fba33ae43c34bbba115df1e892b2034',uuid=ae9134ec-5953-49ad-b32f-a00a6310e497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "address": "fa:16:3e:a9:b3:cd", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a3191-9b", "ovs_interfaceid": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Converting VIF {"id": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "address": "fa:16:3e:a9:b3:cd", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a3191-9b", "ovs_interfaceid": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b3:cd,bridge_name='br-int',has_traffic_filtering=True,id=619a3191-9b7d-437b-bfd8-e03d80e4eddf,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a3191-9b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG os_vif [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b3:cd,bridge_name='br-int',has_traffic_filtering=True,id=619a3191-9b7d-437b-bfd8-e03d80e4eddf,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a3191-9b') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap619a3191-9b, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap619a3191-9b, col_values=(('external_ids', {'iface-id': '619a3191-9b7d-437b-bfd8-e03d80e4eddf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:b3:cd', 'vm-uuid': 'ae9134ec-5953-49ad-b32f-a00a6310e497'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:37 user nova-compute[71516]: INFO os_vif [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b3:cd,bridge_name='br-int',has_traffic_filtering=True,id=619a3191-9b7d-437b-bfd8-e03d80e4eddf,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a3191-9b')
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:34:37 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] No VIF found with MAC fa:16:3e:a9:b3:cd, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:34:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-c717f576-5725-41ee-bab5-4a81cc77e989 req-1bc30b64-ccc7-417e-82dc-78e276df84dd service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Received event network-vif-plugged-619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:34:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c717f576-5725-41ee-bab5-4a81cc77e989 req-1bc30b64-ccc7-417e-82dc-78e276df84dd service nova] Acquiring lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c717f576-5725-41ee-bab5-4a81cc77e989 req-1bc30b64-ccc7-417e-82dc-78e276df84dd service nova] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:38 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c717f576-5725-41ee-bab5-4a81cc77e989 req-1bc30b64-ccc7-417e-82dc-78e276df84dd service nova] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:38 user nova-compute[71516]: DEBUG nova.compute.manager [req-c717f576-5725-41ee-bab5-4a81cc77e989 req-1bc30b64-ccc7-417e-82dc-78e276df84dd service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] No waiting events found dispatching network-vif-plugged-619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:34:38 user nova-compute[71516]: WARNING nova.compute.manager [req-c717f576-5725-41ee-bab5-4a81cc77e989 req-1bc30b64-ccc7-417e-82dc-78e276df84dd service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Received unexpected event network-vif-plugged-619a3191-9b7d-437b-bfd8-e03d80e4eddf for instance with vm_state building and task_state spawning.
Apr 11 23:34:40 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256080.8596423, ae9134ec-5953-49ad-b32f-a00a6310e497 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:34:40 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] VM Resumed (Lifecycle Event)
Apr 11 23:34:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:34:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:34:40 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Instance spawned successfully.
Apr 11 23:34:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:34:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:34:40 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:34:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:34:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:34:40 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:34:40 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256080.860817, ae9134ec-5953-49ad-b32f-a00a6310e497 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:34:40 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] VM Started (Lifecycle Event)
Apr 11 23:34:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:34:40 user nova-compute[71516]: INFO nova.compute.manager [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Took 6.30 seconds to spawn the instance on the hypervisor.
Apr 11 23:34:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:34:40 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:34:40 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:34:41 user nova-compute[71516]: INFO nova.compute.manager [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Took 6.88 seconds to build instance.
Apr 11 23:34:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.995s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-25f129ac-7fbd-4324-9f88-a1dd2e54f4ae req-d71cb47d-d3c0-4f9f-a25c-5ec59642a232 service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Received event network-vif-plugged-619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:34:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25f129ac-7fbd-4324-9f88-a1dd2e54f4ae req-d71cb47d-d3c0-4f9f-a25c-5ec59642a232 service nova] Acquiring lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25f129ac-7fbd-4324-9f88-a1dd2e54f4ae req-d71cb47d-d3c0-4f9f-a25c-5ec59642a232 service nova] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:41 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25f129ac-7fbd-4324-9f88-a1dd2e54f4ae req-d71cb47d-d3c0-4f9f-a25c-5ec59642a232 service nova] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:41 user nova-compute[71516]: DEBUG nova.compute.manager [req-25f129ac-7fbd-4324-9f88-a1dd2e54f4ae req-d71cb47d-d3c0-4f9f-a25c-5ec59642a232 service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] No waiting events found dispatching network-vif-plugged-619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:34:41 user nova-compute[71516]: WARNING nova.compute.manager [req-25f129ac-7fbd-4324-9f88-a1dd2e54f4ae req-d71cb47d-d3c0-4f9f-a25c-5ec59642a232 service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Received unexpected event network-vif-plugged-619a3191-9b7d-437b-bfd8-e03d80e4eddf for instance with vm_state active and task_state None.
Apr 11 23:34:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:45 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:34:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:51 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:34:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:34:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:34:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:34:51 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:34:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:51 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updating instance_info_cache with network_info: [{"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:34:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:34:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:34:51 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:34:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:52 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:34:53 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:34:53 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:34:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8449MB free_disk=25.976654052734375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance ae9134ec-5953-49ad-b32f-a00a6310e497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:34:53 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:34:54 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:34:54 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:34:54 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:34:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:34:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:57 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:34:57 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:34:57 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:34:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:34:58 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:35:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:05 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:35:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:35:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:35:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:35:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:35:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:35:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:35:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:35:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:35:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:35:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:35:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:43 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:35:43 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 23:35:43 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] There are 0 instances to clean {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 23:35:47 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:35:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:35:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:35:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:35:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:35:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:35:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:52 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:35:52 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:35:52 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:35:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:35:53 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:35:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:35:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:35:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:35:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:35:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updating instance_info_cache with network_info: [{"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:35:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:35:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:35:54 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:35:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:35:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:35:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:35:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:35:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:35:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:35:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:35:55 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:35:55 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:35:55 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8576MB free_disk=25.975582122802734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:35:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:35:55 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:35:56 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:35:56 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:35:56 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:35:56 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance ae9134ec-5953-49ad-b32f-a00a6310e497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:35:56 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:35:56 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:35:56 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:35:56 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:35:56 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:35:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:35:57 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:35:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:35:58 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:35:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances with incomplete migration  {{(pid=71516) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 23:35:59 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:35:59 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:36:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:36:06 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:36:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:12 user nova-compute[71516]: INFO nova.compute.manager [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Unrescuing
Apr 11 23:36:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:36:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquired lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:36:12 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:36:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updating instance_info_cache with network_info: [{"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:36:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Releasing lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:36:13 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'flavor' on Instance uuid 16682788-70d1-400d-adc3-0518282c04fa {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:36:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-26783d5c-c5d4-4bd8-9b6e-f260e4a9fc36 req-0ad7f514-c2b1-40da-8fbf-29eac55e88c0 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-unplugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:36:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-26783d5c-c5d4-4bd8-9b6e-f260e4a9fc36 req-0ad7f514-c2b1-40da-8fbf-29eac55e88c0 service nova] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:36:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-26783d5c-c5d4-4bd8-9b6e-f260e4a9fc36 req-0ad7f514-c2b1-40da-8fbf-29eac55e88c0 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:36:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-26783d5c-c5d4-4bd8-9b6e-f260e4a9fc36 req-0ad7f514-c2b1-40da-8fbf-29eac55e88c0 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:36:13 user nova-compute[71516]: DEBUG nova.compute.manager [req-26783d5c-c5d4-4bd8-9b6e-f260e4a9fc36 req-0ad7f514-c2b1-40da-8fbf-29eac55e88c0 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] No waiting events found dispatching network-vif-unplugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:36:13 user nova-compute[71516]: WARNING nova.compute.manager [req-26783d5c-c5d4-4bd8-9b6e-f260e4a9fc36 req-0ad7f514-c2b1-40da-8fbf-29eac55e88c0 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received unexpected event network-vif-unplugged-624afba1-f295-47d2-8419-91f51beeb2a8 for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:36:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:14 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Instance destroyed successfully.
Apr 11 23:36:15 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] No waiting events found dispatching network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:36:15 user nova-compute[71516]: WARNING nova.compute.manager [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received unexpected event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:36:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:36:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] No waiting events found dispatching network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:36:15 user nova-compute[71516]: WARNING nova.compute.manager [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received unexpected event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:36:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for 16682788-70d1-400d-adc3-0518282c04fa due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:36:17 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256177.4788709, 16682788-70d1-400d-adc3-0518282c04fa => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:36:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] VM Resumed (Lifecycle Event)
Apr 11 23:36:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:36:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:36:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:36:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 23:36:17 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256177.4807646, 16682788-70d1-400d-adc3-0518282c04fa => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:36:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] VM Started (Lifecycle Event)
Apr 11 23:36:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:36:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:36:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-32ba03c1-8cf4-4ba6-9a65-63609da11589 req-76071aaa-79cf-48b3-bb6b-013813c5dc06 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:36:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-32ba03c1-8cf4-4ba6-9a65-63609da11589 req-76071aaa-79cf-48b3-bb6b-013813c5dc06 service nova] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:36:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-32ba03c1-8cf4-4ba6-9a65-63609da11589 req-76071aaa-79cf-48b3-bb6b-013813c5dc06 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:36:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-32ba03c1-8cf4-4ba6-9a65-63609da11589 req-76071aaa-79cf-48b3-bb6b-013813c5dc06 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:36:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-32ba03c1-8cf4-4ba6-9a65-63609da11589 req-76071aaa-79cf-48b3-bb6b-013813c5dc06 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] No waiting events found dispatching network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:36:17 user nova-compute[71516]: WARNING nova.compute.manager [req-32ba03c1-8cf4-4ba6-9a65-63609da11589 req-76071aaa-79cf-48b3-bb6b-013813c5dc06 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received unexpected event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 for instance with vm_state active and task_state None.
Apr 11 23:36:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:36:25 user nova-compute[71516]: DEBUG nova.compute.manager [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Received event network-changed-619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:36:25 user nova-compute[71516]: DEBUG nova.compute.manager [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Refreshing instance network info cache due to event network-changed-619a3191-9b7d-437b-bfd8-e03d80e4eddf. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:36:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] Acquiring lock "refresh_cache-ae9134ec-5953-49ad-b32f-a00a6310e497" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:36:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] Acquired lock "refresh_cache-ae9134ec-5953-49ad-b32f-a00a6310e497" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:36:25 user nova-compute[71516]: DEBUG nova.network.neutron [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Refreshing network info cache for port 619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:36:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:26 user nova-compute[71516]: DEBUG nova.network.neutron [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Updated VIF entry in instance network info cache for port 619a3191-9b7d-437b-bfd8-e03d80e4eddf. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:36:26 user nova-compute[71516]: DEBUG nova.network.neutron [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Updating instance_info_cache with network_info: [{"id": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "address": "fa:16:3e:a9:b3:cd", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a3191-9b", "ovs_interfaceid": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:36:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] Releasing lock "refresh_cache-ae9134ec-5953-49ad-b32f-a00a6310e497" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "ae9134ec-5953-49ad-b32f-a00a6310e497" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG nova.objects.instance [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'flavor' on Instance uuid ae9134ec-5953-49ad-b32f-a00a6310e497 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "ae9134ec-5953-49ad-b32f-a00a6310e497" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:36:27 user nova-compute[71516]: INFO nova.compute.manager [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Attaching volume 0a13e25c-a993-444b-8377-fcb263183bb5 to /dev/vdb
Apr 11 23:36:27 user nova-compute[71516]: DEBUG os_brick.utils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b33b412-e4b1-4703-94c0-50fdc1fdde14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[32210999-4424-46f2-8ee0-5f74971d84dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[63109426-955f-4ff6-a272-b2c519524e52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5085fc83-fb7b-4832-bddf-f98444c59b9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:36:27 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:36:27 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5f4948-12da-4f5d-a74e-279a3ac0db50]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG os_brick.utils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:36:27 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Updating existing volume attachment record: 84d30d0d-cd53-40ce-9f83-52695bc54a25 {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:36:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfAeczTo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:36:32 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:36:32 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:36:32 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d654c294-2017-45b5-b9ac-fc7464a3c47c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:36:32 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8dd0c3-6ade-4044-aa0c-421ee66ef455]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5] added
Apr 11 23:36:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d0f246-0aa9-4474-8d44-d6a72e688189]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2640e56-f9ef-4d3f-9f24-a8746b94142f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfAeczTo {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfAeczTo" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2de9f22-9a74-4e50-ae2f-9dd7b73a6c7a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HfAeczTo'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f2d20a-9b78-46af-b5d0-3534b957c067]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf9757c-2f74-4dfc-93d5-94ff0f6c2267]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:36:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:36:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f6db63-b5f2-4031-9fd2-28ffd213550f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5, portal: 172.16.0.220,3260]
Apr 11 23:36:32 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5, portal: 172.16.0.220,3260] successful.
Apr 11 23:36:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6df92f7-b208-4d93-9005-4cf9c75f16f6]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b988adcb-7e24-4929-be59-99f4b767c2d9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:36:32 user nova-compute[71516]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 (non-flash)
Apr 11 23:36:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:36:32 user nova-compute[71516]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 (non-flash)
Apr 11 23:36:32 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9106ecc9-add1-4117-8331-33b5ab3af313]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:36:32 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfAeczTo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:36:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:36:33 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26235306464383566', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:36:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235306464383566', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:36:33 user nova-compute[71516]: DEBUG nova.objects.instance [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'flavor' on Instance uuid ae9134ec-5953-49ad-b32f-a00a6310e497 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:36:33 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 23:36:33 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:36:33 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:36:33 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:36:33 user nova-compute[71516]:   <serial>0a13e25c-a993-444b-8377-fcb263183bb5</serial>
Apr 11 23:36:33 user nova-compute[71516]: </disk>
Apr 11 23:36:33 user nova-compute[71516]:  {{(pid=71516) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 23:36:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:36:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:36:34 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] No VIF found with MAC fa:16:3e:a9:b3:cd, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:36:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.035s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "ae9134ec-5953-49ad-b32f-a00a6310e497" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:36:35 user nova-compute[71516]: INFO nova.compute.manager [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Detaching volume 0a13e25c-a993-444b-8377-fcb263183bb5
Apr 11 23:36:35 user nova-compute[71516]: INFO nova.virt.block_device [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Attempting to driver detach volume 0a13e25c-a993-444b-8377-fcb263183bb5 from mountpoint /dev/vdb
Apr 11 23:36:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Attempting to detach device vdb from instance ae9134ec-5953-49ad-b32f-a00a6310e497 from the persistent domain config. {{(pid=71516) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:36:35 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:36:35 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:36:35 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:36:35 user nova-compute[71516]:   <serial>0a13e25c-a993-444b-8377-fcb263183bb5</serial>
Apr 11 23:36:35 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:36:35 user nova-compute[71516]: </disk>
Apr 11 23:36:35 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:36:35 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Successfully detached device vdb from instance ae9134ec-5953-49ad-b32f-a00a6310e497 from the persistent domain config.
Apr 11 23:36:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae9134ec-5953-49ad-b32f-a00a6310e497 from the live domain config. {{(pid=71516) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 23:36:35 user nova-compute[71516]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:36:35 user nova-compute[71516]:   <source dev="/dev/sdc"/>
Apr 11 23:36:35 user nova-compute[71516]:   <target dev="vdb" bus="virtio"/>
Apr 11 23:36:35 user nova-compute[71516]:   <serial>0a13e25c-a993-444b-8377-fcb263183bb5</serial>
Apr 11 23:36:35 user nova-compute[71516]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 23:36:35 user nova-compute[71516]: </disk>
Apr 11 23:36:35 user nova-compute[71516]:  {{(pid=71516) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Received event <DeviceRemovedEvent: 1681256195.8876083, ae9134ec-5953-49ad-b32f-a00a6310e497 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71516) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae9134ec-5953-49ad-b32f-a00a6310e497 {{(pid=71516) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 23:36:35 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Successfully detached device vdb from instance ae9134ec-5953-49ad-b32f-a00a6310e497 from the live domain config.
Apr 11 23:36:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfAeczTo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:36:35 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:36:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bca563-28b3-4273-b8f3-251e3f89e825]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:36:35 user nova-compute[71516]: No targets found.
Apr 11 23:36:35 user nova-compute[71516]: iSNS:
Apr 11 23:36:35 user nova-compute[71516]: No targets found.
Apr 11 23:36:35 user nova-compute[71516]: STATIC:
Apr 11 23:36:35 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5
Apr 11 23:36:35 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:36:35 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:36:35 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff
Apr 11 23:36:35 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:36:35 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:36:35 user nova-compute[71516]: FIRMWARE:
Apr 11 23:36:35 user nova-compute[71516]: No targets found.
Apr 11 23:36:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:36:35 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:36:35 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab19ae09-0923-4988-9812-2f09f61102a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e091f654-7f9f-41c0-953c-946fa7136d9e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:36:35 user nova-compute[71516]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 (non-flash)
Apr 11 23:36:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:36:35 user nova-compute[71516]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 (non-flash)
Apr 11 23:36:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c430790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fea7be-83fc-4901-80d6-8cb2ff6b4bf1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db6cb50-6fbb-4090-97d6-b679336d1a7a]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[427bde45-a56e-4403-981b-d0fa2cb4528b]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06cdb52-5889-4394-99cb-96a716329a7c]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09776ed-ffbc-4c5c-a44f-0cc5accce637]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a532de2-5d15-4f9e-b887-56d81a215970]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5, portal: 172.16.0.220,3260]
Apr 11 23:36:36 user nova-compute[71516]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5, portal: 172.16.0.220,3260] successful.
Apr 11 23:36:36 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a13e25c-a993-444b-8377-fcb263183bb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ae85dc-cdc6-4b28-91d9-0c4f29d0858a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] <== disconnect_volume: return (293ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:36 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'flavor' on Instance uuid ae9134ec-5953-49ad-b32f-a00a6310e497 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:36:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.567s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:36:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:48 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:36:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:53 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:36:54 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:36:54 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:36:54 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:36:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:36:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:36:54 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:36:54 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid cd42372d-ba80-46bb-8ebb-712e6941d62b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:36:54 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updating instance_info_cache with network_info: [{"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:36:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:36:54 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:36:54 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:36:54 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:36:57 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:36:57 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:36:57 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8592MB free_disk=25.975006103515625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance ae9134ec-5953-49ad-b32f-a00a6310e497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing inventories for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating ProviderTree inventory for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating inventory in ProviderTree for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing aggregate associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, aggregates: None {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 23:36:57 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing trait associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 23:36:58 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:36:58 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:36:58 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:36:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:37:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:37:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:37:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:37:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:07 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:37:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:37:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:37:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:37:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "ae9134ec-5953-49ad-b32f-a00a6310e497" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:37:26 user nova-compute[71516]: INFO nova.compute.manager [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Terminating instance
Apr 11 23:37:26 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Received event network-changed-619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Refreshing instance network info cache due to event network-changed-619a3191-9b7d-437b-bfd8-e03d80e4eddf. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] Acquiring lock "refresh_cache-ae9134ec-5953-49ad-b32f-a00a6310e497" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] Acquired lock "refresh_cache-ae9134ec-5953-49ad-b32f-a00a6310e497" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG nova.network.neutron [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Refreshing network info cache for port 619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-60a55abd-24c4-4a54-bba1-532aa9a5996f req-640d9e4c-fbad-4539-b334-abda10b1bf84 service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Received event network-vif-unplugged-619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-60a55abd-24c4-4a54-bba1-532aa9a5996f req-640d9e4c-fbad-4539-b334-abda10b1bf84 service nova] Acquiring lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-60a55abd-24c4-4a54-bba1-532aa9a5996f req-640d9e4c-fbad-4539-b334-abda10b1bf84 service nova] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-60a55abd-24c4-4a54-bba1-532aa9a5996f req-640d9e4c-fbad-4539-b334-abda10b1bf84 service nova] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-60a55abd-24c4-4a54-bba1-532aa9a5996f req-640d9e4c-fbad-4539-b334-abda10b1bf84 service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] No waiting events found dispatching network-vif-unplugged-619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:37:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-60a55abd-24c4-4a54-bba1-532aa9a5996f req-640d9e4c-fbad-4539-b334-abda10b1bf84 service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Received event network-vif-unplugged-619a3191-9b7d-437b-bfd8-e03d80e4eddf for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:37:27 user nova-compute[71516]: DEBUG nova.network.neutron [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Updated VIF entry in instance network info cache for port 619a3191-9b7d-437b-bfd8-e03d80e4eddf. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:37:27 user nova-compute[71516]: DEBUG nova.network.neutron [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Updating instance_info_cache with network_info: [{"id": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "address": "fa:16:3e:a9:b3:cd", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a3191-9b", "ovs_interfaceid": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:37:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] Releasing lock "refresh_cache-ae9134ec-5953-49ad-b32f-a00a6310e497" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:37:27 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Instance destroyed successfully.
Apr 11 23:37:27 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'resources' on Instance uuid ae9134ec-5953-49ad-b32f-a00a6310e497 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:37:27 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1459997543',display_name='tempest-TestStampPattern-server-1459997543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1459997543',id=43,image_ref='74c41659-7d9e-414c-bd94-94665c6dd7f1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDPm4ZPOCf1l7GfxihjBWYCbrccfGFsoS4jnE01iprxBmAib6g39KNKImt4ZLVsCOh1eFL88paYMZusOg3ArGPCcKgWAPxJaKEnhN2keDRL16gSTkvFeR2q1Q375pTqdw==',key_name='tempest-TestStampPattern-718348001',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:34:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bef1ddbef124fff82634357a1db9594',ramdisk_id='',reservation_id='r-1qr6n27f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6daabd9b-ed06-4bfc-a323-e464f5e29b3c',image_min_disk='1',image_min_ram='0',image_owner_id='6bef1ddbef124fff82634357a1db9594',image_owner_project_name='tempest-TestStampPattern-1577365278',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1577365278-project-member',image_user_id='3fba33ae43c34bbba115df1e892b2034',owner_project_name='tempest-TestStampPattern-1577365278',owner_user_name='tempest-TestStampPattern-1577365278-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:34:41Z,user_data=None,user_id='3fba33ae43c34bbba115df1e892b2034',uuid=ae9134ec-5953-49ad-b32f-a00a6310e497,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "address": "fa:16:3e:a9:b3:cd", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a3191-9b", "ovs_interfaceid": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:37:27 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Converting VIF {"id": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "address": "fa:16:3e:a9:b3:cd", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a3191-9b", "ovs_interfaceid": "619a3191-9b7d-437b-bfd8-e03d80e4eddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:37:27 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:b3:cd,bridge_name='br-int',has_traffic_filtering=True,id=619a3191-9b7d-437b-bfd8-e03d80e4eddf,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a3191-9b') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:37:27 user nova-compute[71516]: DEBUG os_vif [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:b3:cd,bridge_name='br-int',has_traffic_filtering=True,id=619a3191-9b7d-437b-bfd8-e03d80e4eddf,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a3191-9b') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:37:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap619a3191-9b, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:37:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:37:27 user nova-compute[71516]: INFO os_vif [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:b3:cd,bridge_name='br-int',has_traffic_filtering=True,id=619a3191-9b7d-437b-bfd8-e03d80e4eddf,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a3191-9b')
Apr 11 23:37:27 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Deleting instance files /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497_del
Apr 11 23:37:27 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Deletion of /opt/stack/data/nova/instances/ae9134ec-5953-49ad-b32f-a00a6310e497_del complete
Apr 11 23:37:27 user nova-compute[71516]: INFO nova.compute.manager [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 23:37:27 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:37:27 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:37:27 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:37:28 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:37:28 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Took 0.85 seconds to deallocate network for instance.
Apr 11 23:37:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:37:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:37:28 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:37:28 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:37:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:37:28 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Deleted allocations for instance ae9134ec-5953-49ad-b32f-a00a6310e497
Apr 11 23:37:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.104s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:37:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Received event network-vif-plugged-619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:37:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] Acquiring lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:37:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:37:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] Lock "ae9134ec-5953-49ad-b32f-a00a6310e497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:37:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] No waiting events found dispatching network-vif-plugged-619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:37:28 user nova-compute[71516]: WARNING nova.compute.manager [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Received unexpected event network-vif-plugged-619a3191-9b7d-437b-bfd8-e03d80e4eddf for instance with vm_state deleted and task_state None.
Apr 11 23:37:28 user nova-compute[71516]: DEBUG nova.compute.manager [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Received event network-vif-deleted-619a3191-9b7d-437b-bfd8-e03d80e4eddf {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:37:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:37:42 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681256247.0741937, ae9134ec-5953-49ad-b32f-a00a6310e497 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:37:42 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] VM Stopped (Lifecycle Event)
Apr 11 23:37:42 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b907e757-c448-4ceb-8600-0501c118954e None None] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:37:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:37:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:37:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:37:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:37:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:37:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:55 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:37:55 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:37:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updating instance_info_cache with network_info: [{"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:37:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:37:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:37:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:37:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:37:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:37:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:37:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:37:57 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:37:57 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:37:57 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8675MB free_disk=25.975170135498047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:37:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:37:57 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:37:57 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:37:57 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:37:57 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:37:57 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:37:57 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:37:58 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:37:58 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:37:58 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:37:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:38:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:02 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "22b986da-959f-4183-8f01-70cd5fab90fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "22b986da-959f-4183-8f01-70cd5fab90fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:38:04 user nova-compute[71516]: INFO nova.compute.claims [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Claim successful on node user
Apr 11 23:38:04 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG nova.network.neutron [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:38:04 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:38:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG nova.policy [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:38:04 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Creating image(s)
Apr 11 23:38:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "/opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "/opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "/opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk 1073741824" returned: 0 in 0.050s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.145s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG nova.network.neutron [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Successfully created port: 72c117df-79e3-423b-952f-6f716efb70e0 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Cannot resize image /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG nova.objects.instance [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'migration_context' on Instance uuid 22b986da-959f-4183-8f01-70cd5fab90fb {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Ensure instance console log exists: /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.network.neutron [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Successfully updated port: 72c117df-79e3-423b-952f-6f716efb70e0 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "refresh_cache-22b986da-959f-4183-8f01-70cd5fab90fb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquired lock "refresh_cache-22b986da-959f-4183-8f01-70cd5fab90fb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.network.neutron [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.network.neutron [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.compute.manager [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Received event network-changed-72c117df-79e3-423b-952f-6f716efb70e0 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.compute.manager [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Refreshing instance network info cache due to event network-changed-72c117df-79e3-423b-952f-6f716efb70e0. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] Acquiring lock "refresh_cache-22b986da-959f-4183-8f01-70cd5fab90fb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.network.neutron [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Updating instance_info_cache with network_info: [{"id": "72c117df-79e3-423b-952f-6f716efb70e0", "address": "fa:16:3e:1b:5b:af", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c117df-79", "ovs_interfaceid": "72c117df-79e3-423b-952f-6f716efb70e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Releasing lock "refresh_cache-22b986da-959f-4183-8f01-70cd5fab90fb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Instance network_info: |[{"id": "72c117df-79e3-423b-952f-6f716efb70e0", "address": "fa:16:3e:1b:5b:af", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c117df-79", "ovs_interfaceid": "72c117df-79e3-423b-952f-6f716efb70e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] Acquired lock "refresh_cache-22b986da-959f-4183-8f01-70cd5fab90fb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.network.neutron [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Refreshing network info cache for port 72c117df-79e3-423b-952f-6f716efb70e0 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Start _get_guest_xml network_info=[{"id": "72c117df-79e3-423b-952f-6f716efb70e0", "address": "fa:16:3e:1b:5b:af", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c117df-79", "ovs_interfaceid": "72c117df-79e3-423b-952f-6f716efb70e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:38:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:38:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:38:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-165978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-165978506',id=44,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-ylptdkkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:38:05Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=22b986da-959f-4183-8f01-70cd5fab90fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72c117df-79e3-423b-952f-6f716efb70e0", "address": "fa:16:3e:1b:5b:af", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c117df-79", "ovs_interfaceid": "72c117df-79e3-423b-952f-6f716efb70e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "72c117df-79e3-423b-952f-6f716efb70e0", "address": "fa:16:3e:1b:5b:af", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c117df-79", "ovs_interfaceid": "72c117df-79e3-423b-952f-6f716efb70e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:5b:af,bridge_name='br-int',has_traffic_filtering=True,id=72c117df-79e3-423b-952f-6f716efb70e0,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c117df-79') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.objects.instance [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'pci_devices' on Instance uuid 22b986da-959f-4183-8f01-70cd5fab90fb {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:38:06 user nova-compute[71516]:   <uuid>22b986da-959f-4183-8f01-70cd5fab90fb</uuid>
Apr 11 23:38:06 user nova-compute[71516]:   <name>instance-0000002c</name>
Apr 11 23:38:06 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:38:06 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:38:06 user nova-compute[71516]:   <metadata>
Apr 11 23:38:06 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:38:06 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:38:06 user nova-compute[71516]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-165978506</nova:name>
Apr 11 23:38:06 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:38:06</nova:creationTime>
Apr 11 23:38:06 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:38:06 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:38:06 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:38:06 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:38:06 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:38:06 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:38:06 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:38:06 user nova-compute[71516]:       <nova:owner>
Apr 11 23:38:06 user nova-compute[71516]:         <nova:user uuid="34d0482650674249adb77724a287d53e">tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member</nova:user>
Apr 11 23:38:06 user nova-compute[71516]:         <nova:project uuid="5d1c7064a4f845d1b39a49795d00d9b0">tempest-ServerBootFromVolumeStableRescueTest-948037051</nova:project>
Apr 11 23:38:06 user nova-compute[71516]:       </nova:owner>
Apr 11 23:38:06 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:38:06 user nova-compute[71516]:       <nova:ports>
Apr 11 23:38:06 user nova-compute[71516]:         <nova:port uuid="72c117df-79e3-423b-952f-6f716efb70e0">
Apr 11 23:38:06 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 23:38:06 user nova-compute[71516]:         </nova:port>
Apr 11 23:38:06 user nova-compute[71516]:       </nova:ports>
Apr 11 23:38:06 user nova-compute[71516]:     </nova:instance>
Apr 11 23:38:06 user nova-compute[71516]:   </metadata>
Apr 11 23:38:06 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:38:06 user nova-compute[71516]:     <system>
Apr 11 23:38:06 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:38:06 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:38:06 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:38:06 user nova-compute[71516]:       <entry name="serial">22b986da-959f-4183-8f01-70cd5fab90fb</entry>
Apr 11 23:38:06 user nova-compute[71516]:       <entry name="uuid">22b986da-959f-4183-8f01-70cd5fab90fb</entry>
Apr 11 23:38:06 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:38:06 user nova-compute[71516]:     </system>
Apr 11 23:38:06 user nova-compute[71516]:   </sysinfo>
Apr 11 23:38:06 user nova-compute[71516]:   <os>
Apr 11 23:38:06 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:38:06 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:38:06 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:38:06 user nova-compute[71516]:   </os>
Apr 11 23:38:06 user nova-compute[71516]:   <features>
Apr 11 23:38:06 user nova-compute[71516]:     <acpi/>
Apr 11 23:38:06 user nova-compute[71516]:     <apic/>
Apr 11 23:38:06 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:38:06 user nova-compute[71516]:   </features>
Apr 11 23:38:06 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:38:06 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:38:06 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:38:06 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:38:06 user nova-compute[71516]:   </clock>
Apr 11 23:38:06 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:38:06 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:38:06 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:38:06 user nova-compute[71516]:   </cpu>
Apr 11 23:38:06 user nova-compute[71516]:   <devices>
Apr 11 23:38:06 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:38:06 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:38:06 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk"/>
Apr 11 23:38:06 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:38:06 user nova-compute[71516]:     </disk>
Apr 11 23:38:06 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:38:06 user nova-compute[71516]:       <mac address="fa:16:3e:1b:5b:af"/>
Apr 11 23:38:06 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:38:06 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:38:06 user nova-compute[71516]:       <target dev="tap72c117df-79"/>
Apr 11 23:38:06 user nova-compute[71516]:     </interface>
Apr 11 23:38:06 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:38:06 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/console.log" append="off"/>
Apr 11 23:38:06 user nova-compute[71516]:     </serial>
Apr 11 23:38:06 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:38:06 user nova-compute[71516]:     <video>
Apr 11 23:38:06 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:38:06 user nova-compute[71516]:     </video>
Apr 11 23:38:06 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:38:06 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:38:06 user nova-compute[71516]:     </rng>
Apr 11 23:38:06 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:38:06 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:38:06 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:38:06 user nova-compute[71516]:     </memballoon>
Apr 11 23:38:06 user nova-compute[71516]:   </devices>
Apr 11 23:38:06 user nova-compute[71516]: </domain>
Apr 11 23:38:06 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:38:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-165978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-165978506',id=44,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-ylptdkkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:38:05Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=22b986da-959f-4183-8f01-70cd5fab90fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72c117df-79e3-423b-952f-6f716efb70e0", "address": "fa:16:3e:1b:5b:af", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c117df-79", "ovs_interfaceid": "72c117df-79e3-423b-952f-6f716efb70e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "72c117df-79e3-423b-952f-6f716efb70e0", "address": "fa:16:3e:1b:5b:af", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c117df-79", "ovs_interfaceid": "72c117df-79e3-423b-952f-6f716efb70e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:5b:af,bridge_name='br-int',has_traffic_filtering=True,id=72c117df-79e3-423b-952f-6f716efb70e0,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c117df-79') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG os_vif [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:5b:af,bridge_name='br-int',has_traffic_filtering=True,id=72c117df-79e3-423b-952f-6f716efb70e0,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c117df-79') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72c117df-79, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72c117df-79, col_values=(('external_ids', {'iface-id': '72c117df-79e3-423b-952f-6f716efb70e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:5b:af', 'vm-uuid': '22b986da-959f-4183-8f01-70cd5fab90fb'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:06 user nova-compute[71516]: INFO os_vif [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:5b:af,bridge_name='br-int',has_traffic_filtering=True,id=72c117df-79e3-423b-952f-6f716efb70e0,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c117df-79')
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:38:06 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No VIF found with MAC fa:16:3e:1b:5b:af, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:38:07 user nova-compute[71516]: DEBUG nova.network.neutron [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Updated VIF entry in instance network info cache for port 72c117df-79e3-423b-952f-6f716efb70e0. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:38:07 user nova-compute[71516]: DEBUG nova.network.neutron [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Updating instance_info_cache with network_info: [{"id": "72c117df-79e3-423b-952f-6f716efb70e0", "address": "fa:16:3e:1b:5b:af", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c117df-79", "ovs_interfaceid": "72c117df-79e3-423b-952f-6f716efb70e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:38:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] Releasing lock "refresh_cache-22b986da-959f-4183-8f01-70cd5fab90fb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:38:07 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:38:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-7a039dd6-7817-44b1-ac32-e86f42899ac9 req-17c7ce07-1091-481a-b11b-88abc67b24ec service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Received event network-vif-plugged-72c117df-79e3-423b-952f-6f716efb70e0 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:38:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7a039dd6-7817-44b1-ac32-e86f42899ac9 req-17c7ce07-1091-481a-b11b-88abc67b24ec service nova] Acquiring lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7a039dd6-7817-44b1-ac32-e86f42899ac9 req-17c7ce07-1091-481a-b11b-88abc67b24ec service nova] Lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-7a039dd6-7817-44b1-ac32-e86f42899ac9 req-17c7ce07-1091-481a-b11b-88abc67b24ec service nova] Lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-7a039dd6-7817-44b1-ac32-e86f42899ac9 req-17c7ce07-1091-481a-b11b-88abc67b24ec service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] No waiting events found dispatching network-vif-plugged-72c117df-79e3-423b-952f-6f716efb70e0 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:38:08 user nova-compute[71516]: WARNING nova.compute.manager [req-7a039dd6-7817-44b1-ac32-e86f42899ac9 req-17c7ce07-1091-481a-b11b-88abc67b24ec service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Received unexpected event network-vif-plugged-72c117df-79e3-423b-952f-6f716efb70e0 for instance with vm_state building and task_state spawning.
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256290.0900204, 22b986da-959f-4183-8f01-70cd5fab90fb => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:38:10 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] VM Resumed (Lifecycle Event)
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:38:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Instance spawned successfully.
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:38:10 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256290.0939531, 22b986da-959f-4183-8f01-70cd5fab90fb => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:38:10 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] VM Started (Lifecycle Event)
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:38:10 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:38:10 user nova-compute[71516]: INFO nova.compute.manager [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Took 5.26 seconds to spawn the instance on the hypervisor.
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:38:10 user nova-compute[71516]: INFO nova.compute.manager [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Took 5.84 seconds to build instance.
Apr 11 23:38:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "22b986da-959f-4183-8f01-70cd5fab90fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.941s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-e8c8bf00-f49e-4aec-90b0-afeba48b984c req-00298a6d-8942-40ba-87fd-44dc99653708 service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Received event network-vif-plugged-72c117df-79e3-423b-952f-6f716efb70e0 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e8c8bf00-f49e-4aec-90b0-afeba48b984c req-00298a6d-8942-40ba-87fd-44dc99653708 service nova] Acquiring lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e8c8bf00-f49e-4aec-90b0-afeba48b984c req-00298a6d-8942-40ba-87fd-44dc99653708 service nova] Lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-e8c8bf00-f49e-4aec-90b0-afeba48b984c req-00298a6d-8942-40ba-87fd-44dc99653708 service nova] Lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-e8c8bf00-f49e-4aec-90b0-afeba48b984c req-00298a6d-8942-40ba-87fd-44dc99653708 service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] No waiting events found dispatching network-vif-plugged-72c117df-79e3-423b-952f-6f716efb70e0 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:38:10 user nova-compute[71516]: WARNING nova.compute.manager [req-e8c8bf00-f49e-4aec-90b0-afeba48b984c req-00298a6d-8942-40ba-87fd-44dc99653708 service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Received unexpected event network-vif-plugged-72c117df-79e3-423b-952f-6f716efb70e0 for instance with vm_state active and task_state None.
Apr 11 23:38:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:38:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:38:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:38:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:38:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:38:19 user nova-compute[71516]: DEBUG nova.compute.manager [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Received event network-changed-5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:38:19 user nova-compute[71516]: DEBUG nova.compute.manager [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Refreshing instance network info cache due to event network-changed-5b75ff13-136e-4805-9959-478fe1165c45. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:38:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] Acquiring lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:38:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] Acquired lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:38:19 user nova-compute[71516]: DEBUG nova.network.neutron [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Refreshing network info cache for port 5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:20 user nova-compute[71516]: INFO nova.compute.manager [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Terminating instance
Apr 11 23:38:20 user nova-compute[71516]: DEBUG nova.compute.manager [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-d2f9aad4-7f22-4ffb-9d70-ba7b9df39420 req-2377c7e4-6234-4edb-b356-d94ed4a2ee48 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Received event network-vif-unplugged-5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d2f9aad4-7f22-4ffb-9d70-ba7b9df39420 req-2377c7e4-6234-4edb-b356-d94ed4a2ee48 service nova] Acquiring lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d2f9aad4-7f22-4ffb-9d70-ba7b9df39420 req-2377c7e4-6234-4edb-b356-d94ed4a2ee48 service nova] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d2f9aad4-7f22-4ffb-9d70-ba7b9df39420 req-2377c7e4-6234-4edb-b356-d94ed4a2ee48 service nova] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-d2f9aad4-7f22-4ffb-9d70-ba7b9df39420 req-2377c7e4-6234-4edb-b356-d94ed4a2ee48 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] No waiting events found dispatching network-vif-unplugged-5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG nova.compute.manager [req-d2f9aad4-7f22-4ffb-9d70-ba7b9df39420 req-2377c7e4-6234-4edb-b356-d94ed4a2ee48 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Received event network-vif-unplugged-5b75ff13-136e-4805-9959-478fe1165c45 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG nova.network.neutron [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updated VIF entry in instance network info cache for port 5b75ff13-136e-4805-9959-478fe1165c45. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG nova.network.neutron [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updating instance_info_cache with network_info: [{"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] Releasing lock "refresh_cache-6daabd9b-ed06-4bfc-a323-e464f5e29b3c" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:38:20 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Instance destroyed successfully.
Apr 11 23:38:20 user nova-compute[71516]: DEBUG nova.objects.instance [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'resources' on Instance uuid 6daabd9b-ed06-4bfc-a323-e464f5e29b3c {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:31:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1183745125',display_name='tempest-TestStampPattern-server-1183745125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1183745125',id=41,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDPm4ZPOCf1l7GfxihjBWYCbrccfGFsoS4jnE01iprxBmAib6g39KNKImt4ZLVsCOh1eFL88paYMZusOg3ArGPCcKgWAPxJaKEnhN2keDRL16gSTkvFeR2q1Q375pTqdw==',key_name='tempest-TestStampPattern-718348001',keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:31:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bef1ddbef124fff82634357a1db9594',ramdisk_id='',reservation_id='r-ai5slsvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1577365278',owner_user_name='tempest-TestStampPattern-1577365278-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:34:31Z,user_data=None,user_id='3fba33ae43c34bbba115df1e892b2034',uuid=6daabd9b-ed06-4bfc-a323-e464f5e29b3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Converting VIF {"id": "5b75ff13-136e-4805-9959-478fe1165c45", "address": "fa:16:3e:ab:bc:44", "network": {"id": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1033194548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bef1ddbef124fff82634357a1db9594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b75ff13-13", "ovs_interfaceid": "5b75ff13-136e-4805-9959-478fe1165c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:bc:44,bridge_name='br-int',has_traffic_filtering=True,id=5b75ff13-136e-4805-9959-478fe1165c45,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b75ff13-13') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG os_vif [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:bc:44,bridge_name='br-int',has_traffic_filtering=True,id=5b75ff13-136e-4805-9959-478fe1165c45,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b75ff13-13') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b75ff13-13, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:38:20 user nova-compute[71516]: INFO os_vif [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:bc:44,bridge_name='br-int',has_traffic_filtering=True,id=5b75ff13-136e-4805-9959-478fe1165c45,network=Network(7d70a371-58db-4a54-b567-b4ef7d0e9cdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b75ff13-13')
Apr 11 23:38:20 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Deleting instance files /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c_del
Apr 11 23:38:20 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Deletion of /opt/stack/data/nova/instances/6daabd9b-ed06-4bfc-a323-e464f5e29b3c_del complete
Apr 11 23:38:20 user nova-compute[71516]: INFO nova.compute.manager [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 23:38:20 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:38:20 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:38:21 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:38:21 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Took 0.77 seconds to deallocate network for instance.
Apr 11 23:38:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-0ff551b8-b66c-48e2-a0d1-40eb9a56474f req-946f2405-fb65-4d8d-b1b4-9ba07cbdfca4 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Received event network-vif-deleted-5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:38:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:21 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:38:21 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:38:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:22 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Deleted allocations for instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c
Apr 11 23:38:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.019s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-57ce9538-646f-4cb8-91d7-f81eae390c6e req-41cc75ed-c7c0-4dea-b2ae-b1793d376d66 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Received event network-vif-plugged-5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:38:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-57ce9538-646f-4cb8-91d7-f81eae390c6e req-41cc75ed-c7c0-4dea-b2ae-b1793d376d66 service nova] Acquiring lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-57ce9538-646f-4cb8-91d7-f81eae390c6e req-41cc75ed-c7c0-4dea-b2ae-b1793d376d66 service nova] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-57ce9538-646f-4cb8-91d7-f81eae390c6e req-41cc75ed-c7c0-4dea-b2ae-b1793d376d66 service nova] Lock "6daabd9b-ed06-4bfc-a323-e464f5e29b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:22 user nova-compute[71516]: DEBUG nova.compute.manager [req-57ce9538-646f-4cb8-91d7-f81eae390c6e req-41cc75ed-c7c0-4dea-b2ae-b1793d376d66 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] No waiting events found dispatching network-vif-plugged-5b75ff13-136e-4805-9959-478fe1165c45 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:38:22 user nova-compute[71516]: WARNING nova.compute.manager [req-57ce9538-646f-4cb8-91d7-f81eae390c6e req-41cc75ed-c7c0-4dea-b2ae-b1793d376d66 service nova] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Received unexpected event network-vif-plugged-5b75ff13-136e-4805-9959-478fe1165c45 for instance with vm_state deleted and task_state None.
Apr 11 23:38:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:35 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681256300.8386877, 6daabd9b-ed06-4bfc-a323-e464f5e29b3c => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:38:35 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] VM Stopped (Lifecycle Event)
Apr 11 23:38:35 user nova-compute[71516]: DEBUG nova.compute.manager [None req-514f18e6-66be-488e-99f4-ad270466652d None None] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:38:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:38:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:38:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:38:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:38:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:38:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:38:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:38:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:38:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:38:56 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:38:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updating instance_info_cache with network_info: [{"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:38:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:38:59 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:38:59 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:38:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8680MB free_disk=26.037425994873047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 22b986da-959f-4183-8f01-70cd5fab90fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:38:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:39:00 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:39:00 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:39:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:39:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:39:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:39:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:39:02 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:39:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:08 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:39:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:39:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:39:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:39:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:39:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:39:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:39:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:39:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:39:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:39:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:39:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:39:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:39:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:39:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:39:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:39:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:39:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:55 user nova-compute[71516]: DEBUG nova.compute.manager [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:39:55 user nova-compute[71516]: INFO nova.compute.manager [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] instance snapshotting
Apr 11 23:39:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:39:55 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Beginning live snapshot process
Apr 11 23:39:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json -f qcow2 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:39:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:39:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:39:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:39:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json -f qcow2 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:39:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:39:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:39:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:39:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc2jd99nl/ace5f442b56949d38cd514e8579aa42a.delta 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:39:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc2jd99nl/ace5f442b56949d38cd514e8579aa42a.delta 1073741824" returned: 0 in 0.051s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:39:56 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 23:39:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:39:57 user nova-compute[71516]: DEBUG nova.virt.libvirt.guest [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71516) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 23:39:57 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 23:39:57 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:39:57 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc2jd99nl/ace5f442b56949d38cd514e8579aa42a.delta /opt/stack/data/nova/instances/snapshots/tmpc2jd99nl/ace5f442b56949d38cd514e8579aa42a {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc2jd99nl/ace5f442b56949d38cd514e8579aa42a.delta /opt/stack/data/nova/instances/snapshots/tmpc2jd99nl/ace5f442b56949d38cd514e8579aa42a" returned: 0 in 0.469s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:39:58 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Snapshot extracted, beginning image upload
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:39:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:39:59 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:39:59 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:39:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8751MB free_disk=25.987239837646484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:39:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:39:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:39:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:39:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:39:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 22b986da-959f-4183-8f01-70cd5fab90fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:39:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:39:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:39:59 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:39:59 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:39:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:39:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:40:00 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Snapshot image upload complete
Apr 11 23:40:00 user nova-compute[71516]: INFO nova.compute.manager [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Took 4.57 seconds to snapshot the instance on the hypervisor.
Apr 11 23:40:00 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:40:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:40:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:40:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:40:02 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:40:02 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:40:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:40:10 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:40:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:40:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:40:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:40:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:40:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:40:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:40:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Verify base images {{(pid=71516) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Image id 1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a yields fingerprint 75a186defe322614f3ad71371bc73fc34caa51a4 {{(pid=71516) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 11 23:40:20 user nova-compute[71516]: INFO nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] image 1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a at (/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4): checking
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] image 1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a at (/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4): image is in use {{(pid=71516) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71516) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] 16682788-70d1-400d-adc3-0518282c04fa is a valid instance name {{(pid=71516) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] cd42372d-ba80-46bb-8ebb-712e6941d62b is a valid instance name {{(pid=71516) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] cd42372d-ba80-46bb-8ebb-712e6941d62b has a disk file {{(pid=71516) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b is backed by 75a186defe322614f3ad71371bc73fc34caa51a4 {{(pid=71516) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] 22b986da-959f-4183-8f01-70cd5fab90fb is a valid instance name {{(pid=71516) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] 22b986da-959f-4183-8f01-70cd5fab90fb has a disk file {{(pid=71516) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 22b986da-959f-4183-8f01-70cd5fab90fb is backed by 75a186defe322614f3ad71371bc73fc34caa51a4 {{(pid=71516) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 11 23:40:20 user nova-compute[71516]: WARNING nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Unknown base file: /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949
Apr 11 23:40:20 user nova-compute[71516]: WARNING nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Unknown base file: /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e
Apr 11 23:40:20 user nova-compute[71516]: WARNING nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Unknown base file: /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366
Apr 11 23:40:20 user nova-compute[71516]: WARNING nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Unknown base file: /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c
Apr 11 23:40:20 user nova-compute[71516]: WARNING nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Unknown base file: /opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73
Apr 11 23:40:20 user nova-compute[71516]: WARNING nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Unknown base file: /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309
Apr 11 23:40:20 user nova-compute[71516]: WARNING nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Unknown base file: /opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea
Apr 11 23:40:20 user nova-compute[71516]: WARNING nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Unknown base file: /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957
Apr 11 23:40:20 user nova-compute[71516]: INFO nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Active base files: /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4
Apr 11 23:40:20 user nova-compute[71516]: INFO nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Removable base files: /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949 /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366 /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c /opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73 /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309 /opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957
Apr 11 23:40:20 user nova-compute[71516]: INFO nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5e279861008d085bb712b2ee5817ed99a6f9d949
Apr 11 23:40:20 user nova-compute[71516]: INFO nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5fa3259408e2f7ed9f4e943878f36207e4602c6e
Apr 11 23:40:20 user nova-compute[71516]: INFO nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/01d0cc9529d0406f3084ca077ccd40bbbf0a1366
Apr 11 23:40:20 user nova-compute[71516]: INFO nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/986ed538b28109bf7e19dcbc4540fc9b665cda7c
Apr 11 23:40:20 user nova-compute[71516]: INFO nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/79830ac3e79d3b7e0ec96ba998ea7559739a2a73
Apr 11 23:40:20 user nova-compute[71516]: INFO nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a109b12059115c500ce3bad4ac9bae065665a309
Apr 11 23:40:20 user nova-compute[71516]: INFO nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/278fff86670c4eeaa23c25792349ab448cfe7aea
Apr 11 23:40:20 user nova-compute[71516]: INFO nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d9c0121a73e60af4d92170fce80ac347a47fb957
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Verification complete {{(pid=71516) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Verify swap images {{(pid=71516) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.imagecache [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Verify ephemeral images {{(pid=71516) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 11 23:40:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:40:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:40:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:40:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:40:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:40:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:40:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:40:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:40:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:40:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:40:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:40:45 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:40:45 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 23:40:45 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] There are 0 instances to clean {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 23:40:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:40:50 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:40:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:40:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:40:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:40:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:40:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:40:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:40:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:40:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:40:57 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:40:58 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:40:59 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:40:59 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:40:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=25.999427795410156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:40:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:40:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:40:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:40:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:40:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 22b986da-959f-4183-8f01-70cd5fab90fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:40:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:40:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:40:59 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:40:59 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:40:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:40:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:41:00 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:41:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:41:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:41:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:41:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:41:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:41:01 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:41:01 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid cd42372d-ba80-46bb-8ebb-712e6941d62b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:41:01 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updating instance_info_cache with network_info: [{"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:41:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:41:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:41:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:41:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:41:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:41:02 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:41:02 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:41:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:41:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:41:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:41:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:41:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:41:02 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:41:02 user nova-compute[71516]: INFO nova.compute.claims [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Claim successful on node user
Apr 11 23:41:02 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:41:02 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:41:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:41:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:41:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:41:02 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:41:02 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:41:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:41:02 user nova-compute[71516]: INFO nova.virt.block_device [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Booting with volume-backed-image 1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a at /dev/vda
Apr 11 23:41:02 user nova-compute[71516]: DEBUG nova.policy [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:41:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Successfully created port: b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:41:04 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Successfully updated port: b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:41:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "refresh_cache-0a15bbee-baf2-4110-bcc5-a1f8daeb528d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:41:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquired lock "refresh_cache-0a15bbee-baf2-4110-bcc5-a1f8daeb528d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:41:04 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:41:04 user nova-compute[71516]: DEBUG nova.compute.manager [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-changed-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:41:04 user nova-compute[71516]: DEBUG nova.compute.manager [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Refreshing instance network info cache due to event network-changed-b6e46a90-8968-4861-8d7c-f67e22a8addc. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:41:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] Acquiring lock "refresh_cache-0a15bbee-baf2-4110-bcc5-a1f8daeb528d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:41:04 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:41:04 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Updating instance_info_cache with network_info: [{"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:41:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Releasing lock "refresh_cache-0a15bbee-baf2-4110-bcc5-a1f8daeb528d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:41:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Instance network_info: |[{"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:41:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] Acquired lock "refresh_cache-0a15bbee-baf2-4110-bcc5-a1f8daeb528d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:41:04 user nova-compute[71516]: DEBUG nova.network.neutron [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Refreshing network info cache for port b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:41:05 user nova-compute[71516]: DEBUG nova.network.neutron [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Updated VIF entry in instance network info cache for port b6e46a90-8968-4861-8d7c-f67e22a8addc. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:41:05 user nova-compute[71516]: DEBUG nova.network.neutron [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Updating instance_info_cache with network_info: [{"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:41:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] Releasing lock "refresh_cache-0a15bbee-baf2-4110-bcc5-a1f8daeb528d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:41:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:06 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:41:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances with incomplete migration  {{(pid=71516) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG os_brick.utils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef49a07-402e-48c8-bfb6-77e92d58d334]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88fb81b3a4ef\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c73a25-7f28-49af-bbc9-05e381444d97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[815fb8c1-2f60-4fa0-8d0b-975ab659cbc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd67538-22c7-461e-97c7-823affadbc97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): nvme version {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 'nvme version' failed. Not Retrying. {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] nvme not present on system {{(pid=71516) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 23:41:08 user nova-compute[71516]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 23:41:08 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dc4393-1939-43dd-9472-f2f155c6b883]: (4, '') {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71516) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.lightos [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] LIGHTOS: no hostnqn found. {{(pid=71516) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG os_brick.utils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88fb81b3a4ef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:41:08 user nova-compute[71516]: DEBUG nova.virt.block_device [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Updating existing volume attachment record: c5504994-eb32-4c48-9e65-c8154b2f520c {{(pid=71516) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 23:41:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:41:11 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:41:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:41:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:41:12 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Creating image(s)
Apr 11 23:41:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Did not create local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 23:41:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Ensure instance console log exists: /opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:41:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:41:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:41:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:41:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Start _get_guest_xml network_info=[{"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owjZLVRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a15bbee-baf2-4110-bcc5-a1f8daeb528d', 'attached_at': '', 'detached_at': '', 'volume_id': '247721f9-896e-4000-ae72-56bf902a6dc9', 'serial': '247721f9-896e-4000-ae72-56bf902a6dc9'}, 'disk_bus': 'virtio', 'attachment_id': 'c5504994-eb32-4c48-9e65-c8154b2f520c', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:41:12 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:41:12 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:41:12 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owjZLVRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:41:13 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:41:13 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:41:13 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[60476183-6cda-41f2-a5bb-4c6e825d8187]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 23:41:13 user nova-compute[71516]:  {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c6ab0c-93ff-434b-b5ac-a160702e0409]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9] added\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9] added
Apr 11 23:41:13 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1693cf78-8b84-414f-9f00-35a36ca2534a]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4f5579-90f7-41cc-94a4-ba07d35b643e]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v owjZLVRG {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v owjZLVRG" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[120a410c-9c08-4340-b24d-32707d14eb10]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'owjZLVRG'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe5665e-bb90-47ef-93f8-c0518bff9829]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3213f873-d88f-4afc-9af1-714e7a67e42b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:41:13 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:41:13 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --login {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[59de192a-d55e-4a6a-8490-6143f3e2ee2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9, portal: 172.16.0.220,3260]
Apr 11 23:41:13 user nova-compute[71516]: Login to [iface: default, target: iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9, portal: 172.16.0.220,3260] successful.
Apr 11 23:41:13 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeebf53e-1c67-45e3-8006-3eb87ace06b7]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ff0fdb-6751-49b5-bf69-c88709c9d6ce]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:41:13 user nova-compute[71516]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 (non-flash)
Apr 11 23:41:13 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:41:13 user nova-compute[71516]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 (non-flash)
Apr 11 23:41:13 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[21983f35-b8b1-496b-ac30-75638d87bab6]: (4, ('- - 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:41:13 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owjZLVRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23730336236623265', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730336236623265', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-963770929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-963770929',id=45,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-70k3sr2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:41:03Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=0a15bbee-baf2-4110-bcc5-a1f8daeb528d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e9:3d,bridge_name='br-int',has_traffic_filtering=True,id=b6e46a90-8968-4861-8d7c-f67e22a8addc,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e46a90-89') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG nova.objects.instance [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a15bbee-baf2-4110-bcc5-a1f8daeb528d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:41:14 user nova-compute[71516]:   <uuid>0a15bbee-baf2-4110-bcc5-a1f8daeb528d</uuid>
Apr 11 23:41:14 user nova-compute[71516]:   <name>instance-0000002d</name>
Apr 11 23:41:14 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:41:14 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:41:14 user nova-compute[71516]:   <metadata>
Apr 11 23:41:14 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:41:14 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:41:14 user nova-compute[71516]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-963770929</nova:name>
Apr 11 23:41:14 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:41:12</nova:creationTime>
Apr 11 23:41:14 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:41:14 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:41:14 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:41:14 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:41:14 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:41:14 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:41:14 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:41:14 user nova-compute[71516]:       <nova:owner>
Apr 11 23:41:14 user nova-compute[71516]:         <nova:user uuid="34d0482650674249adb77724a287d53e">tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member</nova:user>
Apr 11 23:41:14 user nova-compute[71516]:         <nova:project uuid="5d1c7064a4f845d1b39a49795d00d9b0">tempest-ServerBootFromVolumeStableRescueTest-948037051</nova:project>
Apr 11 23:41:14 user nova-compute[71516]:       </nova:owner>
Apr 11 23:41:14 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:41:14 user nova-compute[71516]:       <nova:ports>
Apr 11 23:41:14 user nova-compute[71516]:         <nova:port uuid="b6e46a90-8968-4861-8d7c-f67e22a8addc">
Apr 11 23:41:14 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 23:41:14 user nova-compute[71516]:         </nova:port>
Apr 11 23:41:14 user nova-compute[71516]:       </nova:ports>
Apr 11 23:41:14 user nova-compute[71516]:     </nova:instance>
Apr 11 23:41:14 user nova-compute[71516]:   </metadata>
Apr 11 23:41:14 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:41:14 user nova-compute[71516]:     <system>
Apr 11 23:41:14 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:41:14 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:41:14 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:41:14 user nova-compute[71516]:       <entry name="serial">0a15bbee-baf2-4110-bcc5-a1f8daeb528d</entry>
Apr 11 23:41:14 user nova-compute[71516]:       <entry name="uuid">0a15bbee-baf2-4110-bcc5-a1f8daeb528d</entry>
Apr 11 23:41:14 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:41:14 user nova-compute[71516]:     </system>
Apr 11 23:41:14 user nova-compute[71516]:   </sysinfo>
Apr 11 23:41:14 user nova-compute[71516]:   <os>
Apr 11 23:41:14 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:41:14 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:41:14 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:41:14 user nova-compute[71516]:   </os>
Apr 11 23:41:14 user nova-compute[71516]:   <features>
Apr 11 23:41:14 user nova-compute[71516]:     <acpi/>
Apr 11 23:41:14 user nova-compute[71516]:     <apic/>
Apr 11 23:41:14 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:41:14 user nova-compute[71516]:   </features>
Apr 11 23:41:14 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:41:14 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:41:14 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:41:14 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:41:14 user nova-compute[71516]:   </clock>
Apr 11 23:41:14 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:41:14 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:41:14 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:41:14 user nova-compute[71516]:   </cpu>
Apr 11 23:41:14 user nova-compute[71516]:   <devices>
Apr 11 23:41:14 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:41:14 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:41:14 user nova-compute[71516]:       <source dev="/dev/sdc"/>
Apr 11 23:41:14 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:41:14 user nova-compute[71516]:       <serial>247721f9-896e-4000-ae72-56bf902a6dc9</serial>
Apr 11 23:41:14 user nova-compute[71516]:     </disk>
Apr 11 23:41:14 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:41:14 user nova-compute[71516]:       <mac address="fa:16:3e:a7:e9:3d"/>
Apr 11 23:41:14 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:41:14 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:41:14 user nova-compute[71516]:       <target dev="tapb6e46a90-89"/>
Apr 11 23:41:14 user nova-compute[71516]:     </interface>
Apr 11 23:41:14 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:41:14 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/console.log" append="off"/>
Apr 11 23:41:14 user nova-compute[71516]:     </serial>
Apr 11 23:41:14 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:41:14 user nova-compute[71516]:     <video>
Apr 11 23:41:14 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:41:14 user nova-compute[71516]:     </video>
Apr 11 23:41:14 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:41:14 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:41:14 user nova-compute[71516]:     </rng>
Apr 11 23:41:14 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:41:14 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:41:14 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:41:14 user nova-compute[71516]:     </memballoon>
Apr 11 23:41:14 user nova-compute[71516]:   </devices>
Apr 11 23:41:14 user nova-compute[71516]: </domain>
Apr 11 23:41:14 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-963770929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-963770929',id=45,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-70k3sr2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:41:03Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=0a15bbee-baf2-4110-bcc5-a1f8daeb528d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e9:3d,bridge_name='br-int',has_traffic_filtering=True,id=b6e46a90-8968-4861-8d7c-f67e22a8addc,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e46a90-89') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG os_vif [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e9:3d,bridge_name='br-int',has_traffic_filtering=True,id=b6e46a90-8968-4861-8d7c-f67e22a8addc,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e46a90-89') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6e46a90-89, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6e46a90-89, col_values=(('external_ids', {'iface-id': 'b6e46a90-8968-4861-8d7c-f67e22a8addc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:e9:3d', 'vm-uuid': '0a15bbee-baf2-4110-bcc5-a1f8daeb528d'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:14 user nova-compute[71516]: INFO os_vif [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e9:3d,bridge_name='br-int',has_traffic_filtering=True,id=b6e46a90-8968-4861-8d7c-f67e22a8addc,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e46a90-89')
Apr 11 23:41:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:41:14 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No VIF found with MAC fa:16:3e:a7:e9:3d, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:41:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-bde4ad4a-7ac3-48fb-8b55-c2d1f39e93e7 req-93628342-356e-4d6f-a868-e9ac55bb8fc3 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:41:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bde4ad4a-7ac3-48fb-8b55-c2d1f39e93e7 req-93628342-356e-4d6f-a868-e9ac55bb8fc3 service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:41:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bde4ad4a-7ac3-48fb-8b55-c2d1f39e93e7 req-93628342-356e-4d6f-a868-e9ac55bb8fc3 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:41:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bde4ad4a-7ac3-48fb-8b55-c2d1f39e93e7 req-93628342-356e-4d6f-a868-e9ac55bb8fc3 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:41:15 user nova-compute[71516]: DEBUG nova.compute.manager [req-bde4ad4a-7ac3-48fb-8b55-c2d1f39e93e7 req-93628342-356e-4d6f-a868-e9ac55bb8fc3 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:41:15 user nova-compute[71516]: WARNING nova.compute.manager [req-bde4ad4a-7ac3-48fb-8b55-c2d1f39e93e7 req-93628342-356e-4d6f-a868-e9ac55bb8fc3 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state building and task_state spawning.
Apr 11 23:41:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256477.7761362, 0a15bbee-baf2-4110-bcc5-a1f8daeb528d => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:41:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] VM Resumed (Lifecycle Event)
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:41:17 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Instance spawned successfully.
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:41:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256477.7799404, 0a15bbee-baf2-4110-bcc5-a1f8daeb528d => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:41:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] VM Started (Lifecycle Event)
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:41:17 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-06c0e428-2bea-4439-935c-852d8a00d5c2 req-17b93d71-d097-4fb0-bf6d-bdf2c32ab283 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-06c0e428-2bea-4439-935c-852d8a00d5c2 req-17b93d71-d097-4fb0-bf6d-bdf2c32ab283 service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-06c0e428-2bea-4439-935c-852d8a00d5c2 req-17b93d71-d097-4fb0-bf6d-bdf2c32ab283 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-06c0e428-2bea-4439-935c-852d8a00d5c2 req-17b93d71-d097-4fb0-bf6d-bdf2c32ab283 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.compute.manager [req-06c0e428-2bea-4439-935c-852d8a00d5c2 req-17b93d71-d097-4fb0-bf6d-bdf2c32ab283 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:41:17 user nova-compute[71516]: WARNING nova.compute.manager [req-06c0e428-2bea-4439-935c-852d8a00d5c2 req-17b93d71-d097-4fb0-bf6d-bdf2c32ab283 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state building and task_state spawning.
Apr 11 23:41:17 user nova-compute[71516]: INFO nova.compute.manager [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Took 4.94 seconds to spawn the instance on the hypervisor.
Apr 11 23:41:17 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:41:17 user nova-compute[71516]: INFO nova.compute.manager [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Took 15.50 seconds to build instance.
Apr 11 23:41:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.591s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:41:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:41:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:41:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:41:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:41:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:41:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_power_states {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid cd42372d-ba80-46bb-8ebb-712e6941d62b {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid 16682788-70d1-400d-adc3-0518282c04fa {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid 22b986da-959f-4183-8f01-70cd5fab90fb {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid 0a15bbee-baf2-4110-bcc5-a1f8daeb528d {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "cd42372d-ba80-46bb-8ebb-712e6941d62b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "16682788-70d1-400d-adc3-0518282c04fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "22b986da-959f-4183-8f01-70cd5fab90fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "22b986da-959f-4183-8f01-70cd5fab90fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "16682788-70d1-400d-adc3-0518282c04fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "22b986da-959f-4183-8f01-70cd5fab90fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:41:28 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:41:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:41:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:41:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:41:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:41:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:52 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:41:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:41:57 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:41:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:00 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:42:00 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8687MB free_disk=25.997596740722656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 22b986da-959f-4183-8f01-70cd5fab90fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing inventories for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating ProviderTree inventory for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating inventory in ProviderTree for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing aggregate associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, aggregates: None {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing trait associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:42:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:42:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:02 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:42:02 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:42:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:42:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:42:02 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:42:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updating instance_info_cache with network_info: [{"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:42:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:42:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:42:03 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:42:03 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:42:03 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:42:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:42:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:42:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:42:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:42:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:42:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:42:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:13 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:42:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:42:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:42:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:42:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:42:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:42:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:42:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:42:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:42:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:42:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:42:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:42:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:42:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:42:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:42:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:42:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:42:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:42:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:42:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:42:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:42:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:53 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:42:53 user nova-compute[71516]: INFO nova.compute.manager [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Rescuing
Apr 11 23:42:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "refresh_cache-0a15bbee-baf2-4110-bcc5-a1f8daeb528d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:42:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquired lock "refresh_cache-0a15bbee-baf2-4110-bcc5-a1f8daeb528d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:42:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:42:53 user nova-compute[71516]: DEBUG nova.network.neutron [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Updating instance_info_cache with network_info: [{"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:42:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Releasing lock "refresh_cache-0a15bbee-baf2-4110-bcc5-a1f8daeb528d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:42:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-fbfa63cc-33d7-43ae-a3c7-cc5795d0e39d req-a9f9dbbe-4cff-4927-ad48-bafcfd8b65ba service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-unplugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-fbfa63cc-33d7-43ae-a3c7-cc5795d0e39d req-a9f9dbbe-4cff-4927-ad48-bafcfd8b65ba service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-fbfa63cc-33d7-43ae-a3c7-cc5795d0e39d req-a9f9dbbe-4cff-4927-ad48-bafcfd8b65ba service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-fbfa63cc-33d7-43ae-a3c7-cc5795d0e39d req-a9f9dbbe-4cff-4927-ad48-bafcfd8b65ba service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-fbfa63cc-33d7-43ae-a3c7-cc5795d0e39d req-a9f9dbbe-4cff-4927-ad48-bafcfd8b65ba service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-unplugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:42:54 user nova-compute[71516]: WARNING nova.compute.manager [req-fbfa63cc-33d7-43ae-a3c7-cc5795d0e39d req-a9f9dbbe-4cff-4927-ad48-bafcfd8b65ba service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-unplugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state active and task_state rescuing.
Apr 11 23:42:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:54 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Instance destroyed successfully.
Apr 11 23:42:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:54 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Attempting a stable device rescue
Apr 11 23:42:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71516) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Instance directory exists: not creating {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 23:42:54 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Creating image(s)
Apr 11 23:42:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "/opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "/opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG nova.objects.instance [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0a15bbee-baf2-4110-bcc5-a1f8daeb528d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "05eb6ad1a32505e7e2883aa21dace604e18c49f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:42:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "05eb6ad1a32505e7e2883aa21dace604e18c49f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:42:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05eb6ad1a32505e7e2883aa21dace604e18c49f8.part --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05eb6ad1a32505e7e2883aa21dace604e18c49f8.part --force-share --output=json" returned: 0 in 0.154s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:55 user nova-compute[71516]: DEBUG nova.virt.images [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 9a2e42e2-df32-45d0-96c1-a0a05799dc5e was qcow2, converting to raw {{(pid=71516) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 23:42:55 user nova-compute[71516]: DEBUG nova.privsep.utils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71516) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 23:42:55 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05eb6ad1a32505e7e2883aa21dace604e18c49f8.part /opt/stack/data/nova/instances/_base/05eb6ad1a32505e7e2883aa21dace604e18c49f8.converted {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:42:56 user nova-compute[71516]: WARNING nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state active and task_state rescuing.
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:42:56 user nova-compute[71516]: WARNING nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state active and task_state rescuing.
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:42:56 user nova-compute[71516]: WARNING nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state active and task_state rescuing.
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-unplugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-unplugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:42:56 user nova-compute[71516]: WARNING nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-unplugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state active and task_state rescuing.
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:42:56 user nova-compute[71516]: WARNING nova.compute.manager [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state active and task_state rescuing.
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05eb6ad1a32505e7e2883aa21dace604e18c49f8.part /opt/stack/data/nova/instances/_base/05eb6ad1a32505e7e2883aa21dace604e18c49f8.converted" returned: 0 in 0.532s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05eb6ad1a32505e7e2883aa21dace604e18c49f8.converted --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05eb6ad1a32505e7e2883aa21dace604e18c49f8.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "05eb6ad1a32505e7e2883aa21dace604e18c49f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.700s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "05eb6ad1a32505e7e2883aa21dace604e18c49f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "05eb6ad1a32505e7e2883aa21dace604e18c49f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05eb6ad1a32505e7e2883aa21dace604e18c49f8 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05eb6ad1a32505e7e2883aa21dace604e18c49f8 --force-share --output=json" returned: 0 in 0.130s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05eb6ad1a32505e7e2883aa21dace604e18c49f8,backing_fmt=raw /opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.rescue {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05eb6ad1a32505e7e2883aa21dace604e18c49f8,backing_fmt=raw /opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.rescue" returned: 0 in 0.052s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "05eb6ad1a32505e7e2883aa21dace604e18c49f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.objects.instance [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'migration_context' on Instance uuid 0a15bbee-baf2-4110-bcc5-a1f8daeb528d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Start _get_guest_xml network_info=[{"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "vif_mac": "fa:16:3e:a7:e9:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9a2e42e2-df32-45d0-96c1-a0a05799dc5e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owjZLVRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '0a15bbee-baf2-4110-bcc5-a1f8daeb528d', 'attached_at': '', 'detached_at': '', 'volume_id': '247721f9-896e-4000-ae72-56bf902a6dc9', 'serial': '247721f9-896e-4000-ae72-56bf902a6dc9'}, 'disk_bus': 'virtio', 'attachment_id': 'c5504994-eb32-4c48-9e65-c8154b2f520c', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.objects.instance [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'resources' on Instance uuid 0a15bbee-baf2-4110-bcc5-a1f8daeb528d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.objects.instance [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'numa_topology' on Instance uuid 0a15bbee-baf2-4110-bcc5-a1f8daeb528d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:42:56 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:42:56 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.objects.instance [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a15bbee-baf2-4110-bcc5-a1f8daeb528d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Calling os-brick to attach iSCSI Volume {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owjZLVRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:42:56 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:42:56 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:42:56 user nova-compute[71516]: INFO os_brick.initiator.connectors.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[239fd750-2b90-4649-a9e1-81a583c80caf]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = owjZLVRG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 23:42:56 user nova-compute[71516]: node.name = iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9
Apr 11 23:42:56 user nova-compute[71516]: node.tpgt = -1
Apr 11 23:42:56 user nova-compute[71516]: node.startup = automatic
Apr 11 23:42:56 user nova-compute[71516]: node.leading_login = No
Apr 11 23:42:56 user nova-compute[71516]: iface.iscsi_ifacename = default
Apr 11 23:42:56 user nova-compute[71516]: iface.net_ifacename = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.ipaddress = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.prefix_len = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.hwaddress = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.transport_name = tcp
Apr 11 23:42:56 user nova-compute[71516]: iface.initiatorname = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.state = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.vlan_id = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.vlan_priority = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.vlan_state = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.iface_num = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.mtu = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.port = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.bootproto = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.subnet_mask = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.gateway = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.dhcp_alt_client_id = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.dhcp_dns = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.dhcp_learn_iqn = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.dhcp_vendor_id_state = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.dhcp_vendor_id = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.dhcp_slp_da = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.fragmentation = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.gratuitous_arp = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.incoming_forwarding = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.tos_state = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.tos = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.ttl = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.delayed_ack = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.tcp_nagle = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.tcp_wsf_state = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.tcp_wsf = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.tcp_timer_scale = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.tcp_timestamp = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.redirect = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.def_task_mgmt_timeout = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.header_digest = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.data_digest = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.immediate_data = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.initial_r2t = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.data_seq_inorder = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.data_pdu_inorder = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.erl = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.max_receive_data_len = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.first_burst_len = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.max_outstanding_r2t = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.max_burst_len = 0
Apr 11 23:42:56 user nova-compute[71516]: iface.chap_auth = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.bidi_chap = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.strict_login_compliance = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.discovery_auth = <empty>
Apr 11 23:42:56 user nova-compute[71516]: iface.discovery_logout = <empty>
Apr 11 23:42:56 user nova-compute[71516]: node.discovery_address = <empty>
Apr 11 23:42:56 user nova-compute[71516]: node.discovery_port = 0
Apr 11 23:42:56 user nova-compute[71516]: node.discovery_type = static
Apr 11 23:42:56 user nova-compute[71516]: node.session.initial_cmdsn = 0
Apr 11 23:42:56 user nova-compute[71516]: node.session.initial_login_retry_max = 8
Apr 11 23:42:56 user nova-compute[71516]: node.session.xmit_thread_priority = -20
Apr 11 23:42:56 user nova-compute[71516]: node.session.cmds_max = 128
Apr 11 23:42:56 user nova-compute[71516]: node.session.queue_depth = 32
Apr 11 23:42:56 user nova-compute[71516]: node.session.nr_sessions = 1
Apr 11 23:42:56 user nova-compute[71516]: node.session.auth.authmethod = CHAP
Apr 11 23:42:56 user nova-compute[71516]: node.session.auth.username = owjZLVRG
Apr 11 23:42:56 user nova-compute[71516]: node.session.auth.password = ***
Apr 11 23:42:56 user nova-compute[71516]: node.session.auth.username_in = <empty>
Apr 11 23:42:56 user nova-compute[71516]: node.session.auth.password_in = <empty>
Apr 11 23:42:56 user nova-compute[71516]: node.session.auth.chap_algs = MD5
Apr 11 23:42:56 user nova-compute[71516]: node.session.timeo.replacement_timeout = 120
Apr 11 23:42:56 user nova-compute[71516]: node.session.err_timeo.abort_timeout = 15
Apr 11 23:42:56 user nova-compute[71516]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 23:42:56 user nova-compute[71516]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 23:42:56 user nova-compute[71516]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 23:42:56 user nova-compute[71516]: node.session.iscsi.FastAbort = Yes
Apr 11 23:42:56 user nova-compute[71516]: node.session.iscsi.InitialR2T = No
Apr 11 23:42:56 user nova-compute[71516]: node.session.iscsi.ImmediateData = Yes
Apr 11 23:42:56 user nova-compute[71516]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 23:42:56 user nova-compute[71516]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 23:42:56 user nova-compute[71516]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 23:42:56 user nova-compute[71516]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 23:42:56 user nova-compute[71516]: node.session.iscsi.MaxConnections = 1
Apr 11 23:42:56 user nova-compute[71516]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 23:42:56 user nova-compute[71516]: node.session.iscsi.ERL = 0
Apr 11 23:42:56 user nova-compute[71516]: node.session.scan = manual
Apr 11 23:42:56 user nova-compute[71516]: node.session.reopen_max = 0
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].address = 172.16.0.220
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].port = 3260
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].startup = manual
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].tcp.window_size = 524288
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].tcp.type_of_service = 0
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].timeo.logout_timeout = 15
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].timeo.login_timeout = 15
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].timeo.auth_timeout = 45
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].iscsi.DataDigest = None
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].iscsi.IFMarker = No
Apr 11 23:42:56 user nova-compute[71516]: node.conn[0].iscsi.OFMarker = No
Apr 11 23:42:56 user nova-compute[71516]: # END RECORD
Apr 11 23:42:56 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a868d80-5f5d-44da-885a-88854f5df72c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9be9b24-9361-405b-9e78-df431d5781b2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v owjZLVRG {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v owjZLVRG" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0f2f01-11a1-4d41-ab9a-12d2e9eb0db2]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'owjZLVRG'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6965b0-892d-40d4-bf50-5a290dc16561]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd57a1e-7e27-452e-b4be-81f69c682bb3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:42:56 user nova-compute[71516]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 (non-flash)
Apr 11 23:42:56 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:42:56 user nova-compute[71516]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 (non-flash)
Apr 11 23:42:56 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.131s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Connected to 172.16.0.220:3260 {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] HCTL ('34', '0', '0', 0) found on session 53 with lun 0 {{(pid=71516) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71516) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7eeb8de-7cbb-4ac2-9e4e-248ef63edb5a]: (4, ('0 0 0', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Searching for a device in session 53 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71516) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owjZLVRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71516) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.153s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] <== connect_volume: return (155ms) {'type': 'block', 'scsi_wwn': '23730336236623265', 'path': '/dev/sdc'} {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730336236623265', 'path': '/dev/sdc'} {{(pid=71516) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-963770929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-963770929',id=45,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-70k3sr2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:41:18Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=0a15bbee-baf2-4110-bcc5-a1f8daeb528d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "vif_mac": "fa:16:3e:a7:e9:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "vif_mac": "fa:16:3e:a7:e9:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:e9:3d,bridge_name='br-int',has_traffic_filtering=True,id=b6e46a90-8968-4861-8d7c-f67e22a8addc,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e46a90-89') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.objects.instance [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a15bbee-baf2-4110-bcc5-a1f8daeb528d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:42:56 user nova-compute[71516]:   <uuid>0a15bbee-baf2-4110-bcc5-a1f8daeb528d</uuid>
Apr 11 23:42:56 user nova-compute[71516]:   <name>instance-0000002d</name>
Apr 11 23:42:56 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:42:56 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:42:56 user nova-compute[71516]:   <metadata>
Apr 11 23:42:56 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:42:56 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:42:56 user nova-compute[71516]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-963770929</nova:name>
Apr 11 23:42:56 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:42:56</nova:creationTime>
Apr 11 23:42:56 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:42:56 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:42:56 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:42:56 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:42:56 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:42:56 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:42:56 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:42:56 user nova-compute[71516]:       <nova:owner>
Apr 11 23:42:56 user nova-compute[71516]:         <nova:user uuid="34d0482650674249adb77724a287d53e">tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member</nova:user>
Apr 11 23:42:56 user nova-compute[71516]:         <nova:project uuid="5d1c7064a4f845d1b39a49795d00d9b0">tempest-ServerBootFromVolumeStableRescueTest-948037051</nova:project>
Apr 11 23:42:56 user nova-compute[71516]:       </nova:owner>
Apr 11 23:42:56 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:42:56 user nova-compute[71516]:       <nova:ports>
Apr 11 23:42:56 user nova-compute[71516]:         <nova:port uuid="b6e46a90-8968-4861-8d7c-f67e22a8addc">
Apr 11 23:42:56 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 23:42:56 user nova-compute[71516]:         </nova:port>
Apr 11 23:42:56 user nova-compute[71516]:       </nova:ports>
Apr 11 23:42:56 user nova-compute[71516]:     </nova:instance>
Apr 11 23:42:56 user nova-compute[71516]:   </metadata>
Apr 11 23:42:56 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:42:56 user nova-compute[71516]:     <system>
Apr 11 23:42:56 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:42:56 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:42:56 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:42:56 user nova-compute[71516]:       <entry name="serial">0a15bbee-baf2-4110-bcc5-a1f8daeb528d</entry>
Apr 11 23:42:56 user nova-compute[71516]:       <entry name="uuid">0a15bbee-baf2-4110-bcc5-a1f8daeb528d</entry>
Apr 11 23:42:56 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:42:56 user nova-compute[71516]:     </system>
Apr 11 23:42:56 user nova-compute[71516]:   </sysinfo>
Apr 11 23:42:56 user nova-compute[71516]:   <os>
Apr 11 23:42:56 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:42:56 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:42:56 user nova-compute[71516]:   </os>
Apr 11 23:42:56 user nova-compute[71516]:   <features>
Apr 11 23:42:56 user nova-compute[71516]:     <acpi/>
Apr 11 23:42:56 user nova-compute[71516]:     <apic/>
Apr 11 23:42:56 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:42:56 user nova-compute[71516]:   </features>
Apr 11 23:42:56 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:42:56 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:42:56 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:42:56 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:42:56 user nova-compute[71516]:   </clock>
Apr 11 23:42:56 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:42:56 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:42:56 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:42:56 user nova-compute[71516]:   </cpu>
Apr 11 23:42:56 user nova-compute[71516]:   <devices>
Apr 11 23:42:56 user nova-compute[71516]:     <disk type="block" device="disk">
Apr 11 23:42:56 user nova-compute[71516]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 23:42:56 user nova-compute[71516]:       <source dev="/dev/sdc"/>
Apr 11 23:42:56 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:42:56 user nova-compute[71516]:       <serial>247721f9-896e-4000-ae72-56bf902a6dc9</serial>
Apr 11 23:42:56 user nova-compute[71516]:     </disk>
Apr 11 23:42:56 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:42:56 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:42:56 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.rescue"/>
Apr 11 23:42:56 user nova-compute[71516]:       <target dev="vdb" bus="virtio"/>
Apr 11 23:42:56 user nova-compute[71516]:       <boot order="1"/>
Apr 11 23:42:56 user nova-compute[71516]:     </disk>
Apr 11 23:42:56 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:42:56 user nova-compute[71516]:       <mac address="fa:16:3e:a7:e9:3d"/>
Apr 11 23:42:56 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:42:56 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:42:56 user nova-compute[71516]:       <target dev="tapb6e46a90-89"/>
Apr 11 23:42:56 user nova-compute[71516]:     </interface>
Apr 11 23:42:56 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:42:56 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/console.log" append="off"/>
Apr 11 23:42:56 user nova-compute[71516]:     </serial>
Apr 11 23:42:56 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:42:56 user nova-compute[71516]:     <video>
Apr 11 23:42:56 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:42:56 user nova-compute[71516]:     </video>
Apr 11 23:42:56 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:42:56 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:42:56 user nova-compute[71516]:     </rng>
Apr 11 23:42:56 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:42:56 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:42:56 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:42:56 user nova-compute[71516]:     </memballoon>
Apr 11 23:42:56 user nova-compute[71516]:   </devices>
Apr 11 23:42:56 user nova-compute[71516]: </domain>
Apr 11 23:42:56 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:42:56 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Instance destroyed successfully.
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:42:56 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] No VIF found with MAC fa:16:3e:a7:e9:3d, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:42:57 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:42:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-cc660754-66a2-42b0-9361-bfd726b4af6f req-9e8323d2-21e5-43b0-a854-a34398202924 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:42:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cc660754-66a2-42b0-9361-bfd726b4af6f req-9e8323d2-21e5-43b0-a854-a34398202924 service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:42:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cc660754-66a2-42b0-9361-bfd726b4af6f req-9e8323d2-21e5-43b0-a854-a34398202924 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:42:58 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cc660754-66a2-42b0-9361-bfd726b4af6f req-9e8323d2-21e5-43b0-a854-a34398202924 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:42:58 user nova-compute[71516]: DEBUG nova.compute.manager [req-cc660754-66a2-42b0-9361-bfd726b4af6f req-9e8323d2-21e5-43b0-a854-a34398202924 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:42:58 user nova-compute[71516]: WARNING nova.compute.manager [req-cc660754-66a2-42b0-9361-bfd726b4af6f req-9e8323d2-21e5-43b0-a854-a34398202924 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state active and task_state rescuing.
Apr 11 23:42:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.rescue --force-share --output=json" returned: 0 in 0.127s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.rescue --force-share --output=json" returned: 0 in 0.126s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:42:59 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for 0a15bbee-baf2-4110-bcc5-a1f8daeb528d due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256580.5547204, 0a15bbee-baf2-4110-bcc5-a1f8daeb528d => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:43:00 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] VM Resumed (Lifecycle Event)
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-11a8914f-d71d-4233-97b2-879dfb4d00f7 req-5f8e5318-50b6-4142-a97e-6a1d1c3b8402 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-11a8914f-d71d-4233-97b2-879dfb4d00f7 req-5f8e5318-50b6-4142-a97e-6a1d1c3b8402 service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-11a8914f-d71d-4233-97b2-879dfb4d00f7 req-5f8e5318-50b6-4142-a97e-6a1d1c3b8402 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-11a8914f-d71d-4233-97b2-879dfb4d00f7 req-5f8e5318-50b6-4142-a97e-6a1d1c3b8402 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.manager [req-11a8914f-d71d-4233-97b2-879dfb4d00f7 req-5f8e5318-50b6-4142-a97e-6a1d1c3b8402 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:43:00 user nova-compute[71516]: WARNING nova.compute.manager [req-11a8914f-d71d-4233-97b2-879dfb4d00f7 req-5f8e5318-50b6-4142-a97e-6a1d1c3b8402 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state active and task_state rescuing.
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:43:00 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:43:00 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8704MB free_disk=25.927391052246094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:43:00 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256580.555354, 0a15bbee-baf2-4110-bcc5-a1f8daeb528d => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:43:00 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] VM Started (Lifecycle Event)
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 22b986da-959f-4183-8f01-70cd5fab90fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:43:00 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:43:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:03 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:43:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:43:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-22b986da-959f-4183-8f01-70cd5fab90fb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:43:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-22b986da-959f-4183-8f01-70cd5fab90fb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:43:04 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:43:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:04 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Updating instance_info_cache with network_info: [{"id": "72c117df-79e3-423b-952f-6f716efb70e0", "address": "fa:16:3e:1b:5b:af", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c117df-79", "ovs_interfaceid": "72c117df-79e3-423b-952f-6f716efb70e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:43:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-22b986da-959f-4183-8f01-70cd5fab90fb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:43:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:43:04 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:43:04 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:43:04 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:43:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:43:06 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:43:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:43:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:43:15 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:43:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:43:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:43:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:43:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:43:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:43:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:54 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:43:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:57 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:43:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:43:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:43:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:43:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:43:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:43:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.rescue --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:44:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:44:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:44:02 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:44:02 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:44:02 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8686MB free_disk=25.926361083984375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:44:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:44:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:44:02 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:44:02 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:44:02 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 22b986da-959f-4183-8f01-70cd5fab90fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:44:02 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:44:02 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:44:02 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:44:02 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:44:02 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:44:02 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:44:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:44:03 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:44:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:44:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:44:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:44:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:44:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:44:03 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid cd42372d-ba80-46bb-8ebb-712e6941d62b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:44:04 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updating instance_info_cache with network_info: [{"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:44:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:44:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:44:04 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:44:04 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:44:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:44:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:44:05 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:44:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:44:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:17 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:44:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:44:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:44:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:44:43 user nova-compute[71516]: INFO nova.compute.manager [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Unrescuing
Apr 11 23:44:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "refresh_cache-0a15bbee-baf2-4110-bcc5-a1f8daeb528d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:44:43 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquired lock "refresh_cache-0a15bbee-baf2-4110-bcc5-a1f8daeb528d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:44:43 user nova-compute[71516]: DEBUG nova.network.neutron [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:44:44 user nova-compute[71516]: DEBUG nova.network.neutron [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Updating instance_info_cache with network_info: [{"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:44:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Releasing lock "refresh_cache-0a15bbee-baf2-4110-bcc5-a1f8daeb528d" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:44:44 user nova-compute[71516]: DEBUG nova.objects.instance [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'flavor' on Instance uuid 0a15bbee-baf2-4110-bcc5-a1f8daeb528d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:44:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-ecfe39d4-b89f-40b6-8a02-38ac4a2aab0e req-12940c70-3963-46b9-992a-5bf91385419d service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-unplugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:44:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ecfe39d4-b89f-40b6-8a02-38ac4a2aab0e req-12940c70-3963-46b9-992a-5bf91385419d service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:44:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ecfe39d4-b89f-40b6-8a02-38ac4a2aab0e req-12940c70-3963-46b9-992a-5bf91385419d service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:44:44 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-ecfe39d4-b89f-40b6-8a02-38ac4a2aab0e req-12940c70-3963-46b9-992a-5bf91385419d service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:44:44 user nova-compute[71516]: DEBUG nova.compute.manager [req-ecfe39d4-b89f-40b6-8a02-38ac4a2aab0e req-12940c70-3963-46b9-992a-5bf91385419d service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-unplugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:44:44 user nova-compute[71516]: WARNING nova.compute.manager [req-ecfe39d4-b89f-40b6-8a02-38ac4a2aab0e req-12940c70-3963-46b9-992a-5bf91385419d service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-unplugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:44:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:45 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Instance destroyed successfully.
Apr 11 23:44:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:44:46 user nova-compute[71516]: WARNING nova.compute.manager [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:44:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:44:46 user nova-compute[71516]: DEBUG nova.compute.manager [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:44:46 user nova-compute[71516]: WARNING nova.compute.manager [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state rescued and task_state unrescuing.
Apr 11 23:44:48 user nova-compute[71516]: DEBUG nova.virt.libvirt.host [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Removed pending event for 0a15bbee-baf2-4110-bcc5-a1f8daeb528d due to event {{(pid=71516) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 23:44:48 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256688.7440262, 0a15bbee-baf2-4110-bcc5-a1f8daeb528d => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:44:48 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] VM Resumed (Lifecycle Event)
Apr 11 23:44:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:44:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:44:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:44:48 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 23:44:48 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681256688.7475638, 0a15bbee-baf2-4110-bcc5-a1f8daeb528d => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:44:48 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] VM Started (Lifecycle Event)
Apr 11 23:44:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:44:48 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:44:48 user nova-compute[71516]: DEBUG nova.compute.manager [req-4b14fd4c-954f-40ab-95ed-e314d8599002 req-0459963a-825c-41a7-bee5-38e6fb21f5f4 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:44:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4b14fd4c-954f-40ab-95ed-e314d8599002 req-0459963a-825c-41a7-bee5-38e6fb21f5f4 service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:44:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4b14fd4c-954f-40ab-95ed-e314d8599002 req-0459963a-825c-41a7-bee5-38e6fb21f5f4 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:44:48 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4b14fd4c-954f-40ab-95ed-e314d8599002 req-0459963a-825c-41a7-bee5-38e6fb21f5f4 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:44:48 user nova-compute[71516]: DEBUG nova.compute.manager [req-4b14fd4c-954f-40ab-95ed-e314d8599002 req-0459963a-825c-41a7-bee5-38e6fb21f5f4 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:44:48 user nova-compute[71516]: WARNING nova.compute.manager [req-4b14fd4c-954f-40ab-95ed-e314d8599002 req-0459963a-825c-41a7-bee5-38e6fb21f5f4 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state active and task_state None.
Apr 11 23:44:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:54 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:44:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:44:57 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:44:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:44:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:44:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:44:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:44:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:44:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updating instance_info_cache with network_info: [{"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-16682788-70d1-400d-adc3-0518282c04fa" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:45:03 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:04 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:45:04 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:45:04 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8698MB free_disk=25.925270080566406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 22b986da-959f-4183-8f01-70cd5fab90fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:45:04 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:45:05 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:45:05 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:45:05 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:45:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:45:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:06 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:45:06 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:45:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:45:07 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:45:09 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:45:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:17 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:45:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:45:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:45:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:45:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:45:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:39 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:44 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:49 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:53 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:45:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 23:45:53 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] There are 0 instances to clean {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 23:45:54 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:45:56 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:45:59 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:45:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:46:04 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:46:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:46:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-22b986da-959f-4183-8f01-70cd5fab90fb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:46:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-22b986da-959f-4183-8f01-70cd5fab90fb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:46:04 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:46:04 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Updating instance_info_cache with network_info: [{"id": "72c117df-79e3-423b-952f-6f716efb70e0", "address": "fa:16:3e:1b:5b:af", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c117df-79", "ovs_interfaceid": "72c117df-79e3-423b-952f-6f716efb70e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:46:04 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-22b986da-959f-4183-8f01-70cd5fab90fb" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:46:04 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:46:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:46:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:46:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8709MB free_disk=25.92465591430664GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:46:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:46:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:46:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:46:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:46:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 22b986da-959f-4183-8f01-70cd5fab90fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:46:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:46:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:46:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:46:06 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:46:06 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:46:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:46:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:46:07 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:46:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:46:08 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:46:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:46:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:14 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:17 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:46:19 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:46:19 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances with incomplete migration  {{(pid=71516) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 23:46:19 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:46:24 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:29 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:46:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:46:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:46:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:46:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:46:34 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:46:34 user nova-compute[71516]: INFO nova.compute.manager [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Terminating instance
Apr 11 23:46:34 user nova-compute[71516]: DEBUG nova.compute.manager [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:46:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:46:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:34 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-095f5c8e-9b41-4823-9991-4c7b368aac9f req-a8036704-db1e-4c6a-a6f6-02462a8b46e5 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-unplugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-095f5c8e-9b41-4823-9991-4c7b368aac9f req-a8036704-db1e-4c6a-a6f6-02462a8b46e5 service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-095f5c8e-9b41-4823-9991-4c7b368aac9f req-a8036704-db1e-4c6a-a6f6-02462a8b46e5 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-095f5c8e-9b41-4823-9991-4c7b368aac9f req-a8036704-db1e-4c6a-a6f6-02462a8b46e5 service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-095f5c8e-9b41-4823-9991-4c7b368aac9f req-a8036704-db1e-4c6a-a6f6-02462a8b46e5 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-unplugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG nova.compute.manager [req-095f5c8e-9b41-4823-9991-4c7b368aac9f req-a8036704-db1e-4c6a-a6f6-02462a8b46e5 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-unplugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:35 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Instance destroyed successfully.
Apr 11 23:46:35 user nova-compute[71516]: DEBUG nova.objects.instance [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'resources' on Instance uuid 0a15bbee-baf2-4110-bcc5-a1f8daeb528d {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-963770929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-963770929',id=45,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:43:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-70k3sr2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:44:49Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=0a15bbee-baf2-4110-bcc5-a1f8daeb528d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "address": "fa:16:3e:a7:e9:3d", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e46a90-89", "ovs_interfaceid": "b6e46a90-8968-4861-8d7c-f67e22a8addc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:e9:3d,bridge_name='br-int',has_traffic_filtering=True,id=b6e46a90-8968-4861-8d7c-f67e22a8addc,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e46a90-89') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_vif [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:e9:3d,bridge_name='br-int',has_traffic_filtering=True,id=b6e46a90-8968-4861-8d7c-f67e22a8addc,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e46a90-89') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6e46a90-89, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:35 user nova-compute[71516]: INFO os_vif [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:e9:3d,bridge_name='br-int',has_traffic_filtering=True,id=b6e46a90-8968-4861-8d7c-f67e22a8addc,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e46a90-89')
Apr 11 23:46:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'owjZLVRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:46:35 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[931e2cb3-c330-4824-8e68-790a95d96a4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:46:35 user nova-compute[71516]: No targets found.
Apr 11 23:46:35 user nova-compute[71516]: iSNS:
Apr 11 23:46:35 user nova-compute[71516]: No targets found.
Apr 11 23:46:35 user nova-compute[71516]: STATIC:
Apr 11 23:46:35 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9
Apr 11 23:46:35 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:46:35 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:46:35 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff
Apr 11 23:46:35 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:46:35 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:46:35 user nova-compute[71516]: FIRMWARE:
Apr 11 23:46:35 user nova-compute[71516]: No targets found.
Apr 11 23:46:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:46:35 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:46:35 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[48805084-4c95-4a02-b7e7-292bc80f69b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[82395978-db5a-4813-9efc-877890cb05ce]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:46:35 user nova-compute[71516]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 (non-flash)
Apr 11 23:46:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:46:35 user nova-compute[71516]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 (non-flash)
Apr 11 23:46:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e0cfb1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9'): ({'sdc'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Removing single pathed devices sdc {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c15c63-49c3-4f50-b936-d32bb0e95ad2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c40d49-ecaa-49b7-b9d5-6e48b85b195b]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flushing IO for device /dev/sdc {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eca3254-f72b-46ee-ae0e-5217681a117f]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[96266223-02d7-4666-bce6-e5f98d5b299a]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] SCSI volumes sdc have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71a17f5-460d-4cd6-814b-99654e2e120d]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[214f47d6-367a-4dac-b20f-c7ef7fac285d]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9, portal: 172.16.0.220,3260]
Apr 11 23:46:35 user nova-compute[71516]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9, portal: 172.16.0.220,3260] successful.
Apr 11 23:46:35 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247721f9-896e-4000-ae72-56bf902a6dc9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[9269e8d5-31cd-4043-9ec1-0719dd909595]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] <== disconnect_volume: return (315ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:46:35 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Deleting instance files /opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d_del
Apr 11 23:46:35 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Deletion of /opt/stack/data/nova/instances/0a15bbee-baf2-4110-bcc5-a1f8daeb528d_del complete
Apr 11 23:46:35 user nova-compute[71516]: INFO nova.compute.manager [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 11 23:46:35 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:46:35 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:46:36 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:46:36 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Took 0.44 seconds to deallocate network for instance.
Apr 11 23:46:36 user nova-compute[71516]: DEBUG nova.compute.manager [req-ea638d86-9a92-4d5f-91b9-39f144988e32 req-a8796194-4f0c-4e8c-833d-69504dabc6a3 service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-deleted-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:46:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-1bcb5c21-1bc7-4000-bb00-a2a034b89ba2 req-eb21960f-c95c-4909-b247-c29bb0d6a94e service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:46:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1bcb5c21-1bc7-4000-bb00-a2a034b89ba2 req-eb21960f-c95c-4909-b247-c29bb0d6a94e service nova] Acquiring lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:46:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1bcb5c21-1bc7-4000-bb00-a2a034b89ba2 req-eb21960f-c95c-4909-b247-c29bb0d6a94e service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:46:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-1bcb5c21-1bc7-4000-bb00-a2a034b89ba2 req-eb21960f-c95c-4909-b247-c29bb0d6a94e service nova] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:46:37 user nova-compute[71516]: DEBUG nova.compute.manager [req-1bcb5c21-1bc7-4000-bb00-a2a034b89ba2 req-eb21960f-c95c-4909-b247-c29bb0d6a94e service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] No waiting events found dispatching network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:46:37 user nova-compute[71516]: WARNING nova.compute.manager [req-1bcb5c21-1bc7-4000-bb00-a2a034b89ba2 req-eb21960f-c95c-4909-b247-c29bb0d6a94e service nova] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Received unexpected event network-vif-plugged-b6e46a90-8968-4861-8d7c-f67e22a8addc for instance with vm_state active and task_state deleting.
Apr 11 23:46:37 user nova-compute[71516]: INFO nova.compute.manager [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Took 0.80 seconds to detach 1 volumes for instance.
Apr 11 23:46:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:46:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:46:37 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:46:37 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:46:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:46:37 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Deleted allocations for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d
Apr 11 23:46:37 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "0a15bbee-baf2-4110-bcc5-a1f8daeb528d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.788s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:46:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:46:50 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681256795.498441, 0a15bbee-baf2-4110-bcc5-a1f8daeb528d => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:46:50 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] VM Stopped (Lifecycle Event)
Apr 11 23:46:50 user nova-compute[71516]: DEBUG nova.compute.manager [None req-1a1ce021-0dd1-4feb-b174-07b6f095fce2 None None] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:46:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:46:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:46:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:46:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:46:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:46:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:46:57 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:46:59 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:47:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:47:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:47:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:47:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=25.92383575439453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 22b986da-959f-4183-8f01-70cd5fab90fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing inventories for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating ProviderTree inventory for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating inventory in ProviderTree for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing aggregate associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, aggregates: None {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing trait associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:47:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:47:07 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:47:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:47:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:47:07 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:47:07 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:47:07 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:47:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:47:08 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:47:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:47:13 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:47:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:47:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:47:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:47:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:47:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:18 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:47:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "22b986da-959f-4183-8f01-70cd5fab90fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "22b986da-959f-4183-8f01-70cd5fab90fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:47:25 user nova-compute[71516]: INFO nova.compute.manager [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Terminating instance
Apr 11 23:47:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG nova.compute.manager [req-c681b6c2-14e8-4121-8624-c6a8210377c3 req-1a1db596-9bb1-4b28-9ca8-a26f5b772550 service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Received event network-vif-unplugged-72c117df-79e3-423b-952f-6f716efb70e0 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c681b6c2-14e8-4121-8624-c6a8210377c3 req-1a1db596-9bb1-4b28-9ca8-a26f5b772550 service nova] Acquiring lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c681b6c2-14e8-4121-8624-c6a8210377c3 req-1a1db596-9bb1-4b28-9ca8-a26f5b772550 service nova] Lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c681b6c2-14e8-4121-8624-c6a8210377c3 req-1a1db596-9bb1-4b28-9ca8-a26f5b772550 service nova] Lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG nova.compute.manager [req-c681b6c2-14e8-4121-8624-c6a8210377c3 req-1a1db596-9bb1-4b28-9ca8-a26f5b772550 service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] No waiting events found dispatching network-vif-unplugged-72c117df-79e3-423b-952f-6f716efb70e0 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:47:25 user nova-compute[71516]: DEBUG nova.compute.manager [req-c681b6c2-14e8-4121-8624-c6a8210377c3 req-1a1db596-9bb1-4b28-9ca8-a26f5b772550 service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Received event network-vif-unplugged-72c117df-79e3-423b-952f-6f716efb70e0 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:47:26 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Instance destroyed successfully.
Apr 11 23:47:26 user nova-compute[71516]: DEBUG nova.objects.instance [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'resources' on Instance uuid 22b986da-959f-4183-8f01-70cd5fab90fb {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:38:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-165978506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-165978506',id=44,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:38:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-ylptdkkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:40:00Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=22b986da-959f-4183-8f01-70cd5fab90fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72c117df-79e3-423b-952f-6f716efb70e0", "address": "fa:16:3e:1b:5b:af", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c117df-79", "ovs_interfaceid": "72c117df-79e3-423b-952f-6f716efb70e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "72c117df-79e3-423b-952f-6f716efb70e0", "address": "fa:16:3e:1b:5b:af", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c117df-79", "ovs_interfaceid": "72c117df-79e3-423b-952f-6f716efb70e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:5b:af,bridge_name='br-int',has_traffic_filtering=True,id=72c117df-79e3-423b-952f-6f716efb70e0,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c117df-79') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG os_vif [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:5b:af,bridge_name='br-int',has_traffic_filtering=True,id=72c117df-79e3-423b-952f-6f716efb70e0,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c117df-79') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72c117df-79, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:26 user nova-compute[71516]: INFO os_vif [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:5b:af,bridge_name='br-int',has_traffic_filtering=True,id=72c117df-79e3-423b-952f-6f716efb70e0,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c117df-79')
Apr 11 23:47:26 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Deleting instance files /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb_del
Apr 11 23:47:26 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Deletion of /opt/stack/data/nova/instances/22b986da-959f-4183-8f01-70cd5fab90fb_del complete
Apr 11 23:47:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:26 user nova-compute[71516]: INFO nova.compute.manager [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 11 23:47:26 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:47:26 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Took 0.43 seconds to deallocate network for instance.
Apr 11 23:47:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-6a1740a4-075f-4141-9949-64c017654085 req-b4bb251b-0f00-424f-a5e0-ccb1921a2986 service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Received event network-vif-deleted-72c117df-79e3-423b-952f-6f716efb70e0 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:47:26 user nova-compute[71516]: INFO nova.compute.manager [req-6a1740a4-075f-4141-9949-64c017654085 req-b4bb251b-0f00-424f-a5e0-ccb1921a2986 service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Neutron deleted interface 72c117df-79e3-423b-952f-6f716efb70e0; detaching it from the instance and deleting it from the info cache
Apr 11 23:47:26 user nova-compute[71516]: DEBUG nova.network.neutron [req-6a1740a4-075f-4141-9949-64c017654085 req-b4bb251b-0f00-424f-a5e0-ccb1921a2986 service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG nova.compute.manager [req-6a1740a4-075f-4141-9949-64c017654085 req-b4bb251b-0f00-424f-a5e0-ccb1921a2986 service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Detach interface failed, port_id=72c117df-79e3-423b-952f-6f716efb70e0, reason: Instance 22b986da-959f-4183-8f01-70cd5fab90fb could not be found. {{(pid=71516) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:47:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:47:26 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Deleted allocations for instance 22b986da-959f-4183-8f01-70cd5fab90fb
Apr 11 23:47:26 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "22b986da-959f-4183-8f01-70cd5fab90fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.394s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:47:27 user nova-compute[71516]: DEBUG nova.compute.manager [req-bec6e9f8-8dcc-4eec-8f0f-2d4f7cb65107 req-3fe64ce6-5304-4783-a824-31ec7709255e service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Received event network-vif-plugged-72c117df-79e3-423b-952f-6f716efb70e0 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:47:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bec6e9f8-8dcc-4eec-8f0f-2d4f7cb65107 req-3fe64ce6-5304-4783-a824-31ec7709255e service nova] Acquiring lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:47:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bec6e9f8-8dcc-4eec-8f0f-2d4f7cb65107 req-3fe64ce6-5304-4783-a824-31ec7709255e service nova] Lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:47:27 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-bec6e9f8-8dcc-4eec-8f0f-2d4f7cb65107 req-3fe64ce6-5304-4783-a824-31ec7709255e service nova] Lock "22b986da-959f-4183-8f01-70cd5fab90fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:47:27 user nova-compute[71516]: DEBUG nova.compute.manager [req-bec6e9f8-8dcc-4eec-8f0f-2d4f7cb65107 req-3fe64ce6-5304-4783-a824-31ec7709255e service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] No waiting events found dispatching network-vif-plugged-72c117df-79e3-423b-952f-6f716efb70e0 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:47:27 user nova-compute[71516]: WARNING nova.compute.manager [req-bec6e9f8-8dcc-4eec-8f0f-2d4f7cb65107 req-3fe64ce6-5304-4783-a824-31ec7709255e service nova] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Received unexpected event network-vif-plugged-72c117df-79e3-423b-952f-6f716efb70e0 for instance with vm_state deleted and task_state None.
Apr 11 23:47:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:41 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681256846.0053177, 22b986da-959f-4183-8f01-70cd5fab90fb => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:47:41 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] VM Stopped (Lifecycle Event)
Apr 11 23:47:41 user nova-compute[71516]: DEBUG nova.compute.manager [None req-5273c6f9-75e0-4f95-b623-70c62a0a4d3a None None] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:47:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:47:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:47:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:47:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:47:59 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:48:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:48:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:48:05 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:48:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:48:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:48:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:48:05 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:48:05 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71516) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 23:48:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:48:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:48:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:48:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:48:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:48:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:48:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8829MB free_disk=26.01470947265625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:48:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:48:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:48:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:48:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:48:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 16682788-70d1-400d-adc3-0518282c04fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:48:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:48:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:48:06 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:48:06 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:48:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:48:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid cd42372d-ba80-46bb-8ebb-712e6941d62b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updating instance_info_cache with network_info: [{"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-cd42372d-ba80-46bb-8ebb-712e6941d62b" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:48:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:48:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:48:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:48:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "16682788-70d1-400d-adc3-0518282c04fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:48:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:48:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:48:15 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:48:15 user nova-compute[71516]: INFO nova.compute.manager [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Terminating instance
Apr 11 23:48:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:48:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-4ef41097-09dd-4134-8d49-207a15cd50f4 req-c42f6fd2-33d2-4305-8372-0e147a36319c service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-unplugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4ef41097-09dd-4134-8d49-207a15cd50f4 req-c42f6fd2-33d2-4305-8372-0e147a36319c service nova] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4ef41097-09dd-4134-8d49-207a15cd50f4 req-c42f6fd2-33d2-4305-8372-0e147a36319c service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-4ef41097-09dd-4134-8d49-207a15cd50f4 req-c42f6fd2-33d2-4305-8372-0e147a36319c service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-4ef41097-09dd-4134-8d49-207a15cd50f4 req-c42f6fd2-33d2-4305-8372-0e147a36319c service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] No waiting events found dispatching network-vif-unplugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG nova.compute.manager [req-4ef41097-09dd-4134-8d49-207a15cd50f4 req-c42f6fd2-33d2-4305-8372-0e147a36319c service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-unplugged-624afba1-f295-47d2-8419-91f51beeb2a8 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:16 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Instance destroyed successfully.
Apr 11 23:48:16 user nova-compute[71516]: DEBUG nova.objects.instance [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'resources' on Instance uuid 16682788-70d1-400d-adc3-0518282c04fa {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-965527401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-965527401',id=42,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:34:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-bcyh9nea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:36:18Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=16682788-70d1-400d-adc3-0518282c04fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "624afba1-f295-47d2-8419-91f51beeb2a8", "address": "fa:16:3e:e3:ba:da", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624afba1-f2", "ovs_interfaceid": "624afba1-f295-47d2-8419-91f51beeb2a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=624afba1-f295-47d2-8419-91f51beeb2a8,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624afba1-f2') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_vif [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=624afba1-f295-47d2-8419-91f51beeb2a8,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624afba1-f2') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap624afba1-f2, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:48:16 user nova-compute[71516]: INFO os_vif [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=624afba1-f295-47d2-8419-91f51beeb2a8,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624afba1-f2')
Apr 11 23:48:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] calling os-brick to detach iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e2c7ba8c0>, {'target_iqn': 'iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTazKIRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 23:48:16 user nova-compute[71516]: WARNING os_brick.initiator.connectors.base [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c361efbf-1f68-44ae-94dc-5ff9c635534b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 23:48:16 user nova-compute[71516]: No targets found.
Apr 11 23:48:16 user nova-compute[71516]: iSNS:
Apr 11 23:48:16 user nova-compute[71516]: No targets found.
Apr 11 23:48:16 user nova-compute[71516]: STATIC:
Apr 11 23:48:16 user nova-compute[71516]: Target: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff
Apr 11 23:48:16 user nova-compute[71516]:         Portal: 172.16.0.220:3260,-1
Apr 11 23:48:16 user nova-compute[71516]:                 Iface Name: default
Apr 11 23:48:16 user nova-compute[71516]: FIRMWARE:
Apr 11 23:48:16 user nova-compute[71516]: No targets found.
Apr 11 23:48:16 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 23:48:16 user nova-compute[71516]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 23:48:16 user nova-compute[71516]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71516) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff', 0)] {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[0add4364-4762-471c-96ca-67c631806b9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0b5fb6-498b-4ba0-9194-90a2268c6fd7]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:48:16 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff (non-flash)
Apr 11 23:48:16 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2c79c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff'): ({'sdb'}, set())}) {{(pid=71516) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Removing single pathed devices sdb {{(pid=71516) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48712c7-d373-4940-925f-42aa41f192c4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64e50ff-8332-4bff-9107-858920582367]: (4, ('ok\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flushing IO for device /dev/sdb {{(pid=71516) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07746ba-8782-4494-a6b1-fd853eeac68c]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71516) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[020564d9-40d6-4fbf-822f-e1c5e790467d]: (4, ('1', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.linuxscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] SCSI volumes sdb have been removed. {{(pid=71516) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff')] {{(pid=71516) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda3c141-d1ee-4243-b4d1-0a21940789d9]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --logout {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[e733f75c-1cf9-4d56-8a23-0ce8a7ded0f6]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff, portal: 172.16.0.220,3260]
Apr 11 23:48:16 user nova-compute[71516]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff, portal: 172.16.0.220,3260] successful.
Apr 11 23:48:16 user nova-compute[71516]:  stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op delete {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cc234e-1331-4705-bd36-6d07edde3bff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81691) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f312289-0977-490f-bba2-d1f44d39c233]: (4, ('', '')) {{(pid=81691) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71516) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.base [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG os_brick.initiator.connectors.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] <== disconnect_volume: return (308ms) None {{(pid=71516) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Disconnected iSCSI Volume {{(pid=71516) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 23:48:16 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Deleting instance files /opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa_del
Apr 11 23:48:16 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Deletion of /opt/stack/data/nova/instances/16682788-70d1-400d-adc3-0518282c04fa_del complete
Apr 11 23:48:16 user nova-compute[71516]: INFO nova.compute.manager [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 11 23:48:16 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:48:16 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 16682788-70d1-400d-adc3-0518282c04fa] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:48:17 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:48:17 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Took 0.78 seconds to deallocate network for instance.
Apr 11 23:48:18 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:48:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:48:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] Acquiring lock "16682788-70d1-400d-adc3-0518282c04fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:48:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:48:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] Lock "16682788-70d1-400d-adc3-0518282c04fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:48:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] No waiting events found dispatching network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:48:18 user nova-compute[71516]: WARNING nova.compute.manager [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received unexpected event network-vif-plugged-624afba1-f295-47d2-8419-91f51beeb2a8 for instance with vm_state active and task_state deleting.
Apr 11 23:48:18 user nova-compute[71516]: DEBUG nova.compute.manager [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Received event network-vif-deleted-624afba1-f295-47d2-8419-91f51beeb2a8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:48:18 user nova-compute[71516]: INFO nova.compute.manager [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Took 0.84 seconds to detach 1 volumes for instance.
Apr 11 23:48:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:48:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:48:18 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:48:18 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:48:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:48:18 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Deleted allocations for instance 16682788-70d1-400d-adc3-0518282c04fa
Apr 11 23:48:18 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "16682788-70d1-400d-adc3-0518282c04fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.913s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:48:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:48:31 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681256896.4553704, 16682788-70d1-400d-adc3-0518282c04fa => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:48:31 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 16682788-70d1-400d-adc3-0518282c04fa] VM Stopped (Lifecycle Event)
Apr 11 23:48:31 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a37dbbfd-a7eb-4ddf-acbb-48d5cc0a3c7d None None] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:48:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:48:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:48:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:48:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:48:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:48:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:48:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:48:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:48:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:48:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:48:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:48:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:48:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:48:59 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:49:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:49:02 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:49:05 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:49:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:49:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:49:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:49:05 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:49:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:49:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:49:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:49:05 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:49:05 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:49:05 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:49:05 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=26.006107330322266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:49:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:49:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance cd42372d-ba80-46bb-8ebb-712e6941d62b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "cd42372d-ba80-46bb-8ebb-712e6941d62b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:49:06 user nova-compute[71516]: INFO nova.compute.manager [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Terminating instance
Apr 11 23:49:06 user nova-compute[71516]: DEBUG nova.compute.manager [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG nova.compute.manager [req-c204d6bd-65bb-4699-9aa9-8b8f5c62efc3 req-3923e670-177d-4d21-85d1-172d472a83d2 service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Received event network-vif-unplugged-b9392b00-89bf-40ad-bcfa-4278fa388813 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c204d6bd-65bb-4699-9aa9-8b8f5c62efc3 req-3923e670-177d-4d21-85d1-172d472a83d2 service nova] Acquiring lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c204d6bd-65bb-4699-9aa9-8b8f5c62efc3 req-3923e670-177d-4d21-85d1-172d472a83d2 service nova] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c204d6bd-65bb-4699-9aa9-8b8f5c62efc3 req-3923e670-177d-4d21-85d1-172d472a83d2 service nova] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG nova.compute.manager [req-c204d6bd-65bb-4699-9aa9-8b8f5c62efc3 req-3923e670-177d-4d21-85d1-172d472a83d2 service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] No waiting events found dispatching network-vif-unplugged-b9392b00-89bf-40ad-bcfa-4278fa388813 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:49:06 user nova-compute[71516]: DEBUG nova.compute.manager [req-c204d6bd-65bb-4699-9aa9-8b8f5c62efc3 req-3923e670-177d-4d21-85d1-172d472a83d2 service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Received event network-vif-unplugged-b9392b00-89bf-40ad-bcfa-4278fa388813 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:49:07 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Instance destroyed successfully.
Apr 11 23:49:07 user nova-compute[71516]: DEBUG nova.objects.instance [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'resources' on Instance uuid cd42372d-ba80-46bb-8ebb-712e6941d62b {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:49:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:29:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-600598354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-600598354',id=40,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:29:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d1c7064a4f845d1b39a49795d00d9b0',ramdisk_id='',reservation_id='r-baham0s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-948037051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:31:30Z,user_data=None,user_id='34d0482650674249adb77724a287d53e',uuid=cd42372d-ba80-46bb-8ebb-712e6941d62b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:49:07 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converting VIF {"id": "b9392b00-89bf-40ad-bcfa-4278fa388813", "address": "fa:16:3e:f0:04:24", "network": {"id": "d160dc36-a006-4029-9540-b148fec639df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-816146711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d1c7064a4f845d1b39a49795d00d9b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9392b00-89", "ovs_interfaceid": "b9392b00-89bf-40ad-bcfa-4278fa388813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:49:07 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:04:24,bridge_name='br-int',has_traffic_filtering=True,id=b9392b00-89bf-40ad-bcfa-4278fa388813,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9392b00-89') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:49:07 user nova-compute[71516]: DEBUG os_vif [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:04:24,bridge_name='br-int',has_traffic_filtering=True,id=b9392b00-89bf-40ad-bcfa-4278fa388813,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9392b00-89') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:49:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:49:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9392b00-89, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:49:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:49:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:49:07 user nova-compute[71516]: INFO os_vif [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:04:24,bridge_name='br-int',has_traffic_filtering=True,id=b9392b00-89bf-40ad-bcfa-4278fa388813,network=Network(d160dc36-a006-4029-9540-b148fec639df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9392b00-89')
Apr 11 23:49:07 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Deleting instance files /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b_del
Apr 11 23:49:07 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Deletion of /opt/stack/data/nova/instances/cd42372d-ba80-46bb-8ebb-712e6941d62b_del complete
Apr 11 23:49:07 user nova-compute[71516]: INFO nova.compute.manager [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 23:49:07 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:49:07 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:49:07 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:49:07 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:49:07 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Took 0.48 seconds to deallocate network for instance.
Apr 11 23:49:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:49:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:49:08 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:49:08 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:49:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:49:08 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Deleted allocations for instance cd42372d-ba80-46bb-8ebb-712e6941d62b
Apr 11 23:49:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.629s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:49:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Received event network-vif-plugged-b9392b00-89bf-40ad-bcfa-4278fa388813 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:49:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] Acquiring lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:49:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:49:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] Lock "cd42372d-ba80-46bb-8ebb-712e6941d62b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:49:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] No waiting events found dispatching network-vif-plugged-b9392b00-89bf-40ad-bcfa-4278fa388813 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:49:08 user nova-compute[71516]: WARNING nova.compute.manager [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Received unexpected event network-vif-plugged-b9392b00-89bf-40ad-bcfa-4278fa388813 for instance with vm_state deleted and task_state None.
Apr 11 23:49:08 user nova-compute[71516]: DEBUG nova.compute.manager [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Received event network-vif-deleted-b9392b00-89bf-40ad-bcfa-4278fa388813 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:49:09 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:49:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:49:09 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:49:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:49:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:49:09 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:49:10 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:49:10 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:49:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:49:15 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:49:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:49:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:49:22 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681256947.3510027, cd42372d-ba80-46bb-8ebb-712e6941d62b => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:49:22 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] VM Stopped (Lifecycle Event)
Apr 11 23:49:22 user nova-compute[71516]: DEBUG nova.compute.manager [None req-91b5ed2c-8f09-4fa7-91f0-a4cf62aeec1f None None] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:49:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:49:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:49:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:49:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:49:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:49:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:49:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:49:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:49:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:49:59 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:49:59 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:04 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:50:06 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:50:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:50:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:50:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:50:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:50:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:50:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:50:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=26.09640121459961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:50:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:50:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:50:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:50:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:50:06 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:50:06 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:50:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:50:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:50:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:50:08 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:50:08 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:50:10 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:50:11 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:50:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:50:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:50:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:50:11 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:50:12 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:50:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:50:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG nova.compute.manager [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:50:19 user nova-compute[71516]: INFO nova.compute.claims [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Claim successful on node user
Apr 11 23:50:19 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG nova.compute.manager [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG nova.compute.manager [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG nova.network.neutron [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:50:19 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:50:19 user nova-compute[71516]: DEBUG nova.compute.manager [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG nova.compute.manager [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:50:19 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Creating image(s)
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "/opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "/opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "/opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG nova.policy [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4660aa9abec348f5a999a753be05b3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52014401b1a74ddcb07e284fb081d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.129s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk 1073741824" returned: 0 in 0.050s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:50:19 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:50:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.156s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:50:20 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:50:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:50:20 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:50:20 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Cannot resize image /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:50:20 user nova-compute[71516]: DEBUG nova.objects.instance [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lazy-loading 'migration_context' on Instance uuid 102fc1ab-bee7-4f14-a9de-729b521eb8ba {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:50:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:50:20 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Ensure instance console log exists: /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:50:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:50:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:50:20 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:50:20 user nova-compute[71516]: DEBUG nova.network.neutron [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Successfully created port: 0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.network.neutron [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Successfully updated port: 0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "refresh_cache-102fc1ab-bee7-4f14-a9de-729b521eb8ba" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquired lock "refresh_cache-102fc1ab-bee7-4f14-a9de-729b521eb8ba" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.network.neutron [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.network.neutron [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Received event network-changed-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.compute.manager [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Refreshing instance network info cache due to event network-changed-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] Acquiring lock "refresh_cache-102fc1ab-bee7-4f14-a9de-729b521eb8ba" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.network.neutron [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Updating instance_info_cache with network_info: [{"id": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "address": "fa:16:3e:e0:21:ba", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d43f907-d7", "ovs_interfaceid": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Releasing lock "refresh_cache-102fc1ab-bee7-4f14-a9de-729b521eb8ba" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.compute.manager [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Instance network_info: |[{"id": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "address": "fa:16:3e:e0:21:ba", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d43f907-d7", "ovs_interfaceid": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] Acquired lock "refresh_cache-102fc1ab-bee7-4f14-a9de-729b521eb8ba" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.network.neutron [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Refreshing network info cache for port 0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Start _get_guest_xml network_info=[{"id": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "address": "fa:16:3e:e0:21:ba", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d43f907-d7", "ovs_interfaceid": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:50:21 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:50:21 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:50:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-365157374',display_name='tempest-VolumesActionsTest-instance-365157374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-365157374',id=46,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52014401b1a74ddcb07e284fb081d5bc',ramdisk_id='',reservation_id='r-am3l5tcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1048592318',owner_user_name='tempest-VolumesActionsTest-1048592318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:50:20Z,user_data=None,user_id='4660aa9abec348f5a999a753be05b3e7',uuid=102fc1ab-bee7-4f14-a9de-729b521eb8ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "address": "fa:16:3e:e0:21:ba", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d43f907-d7", "ovs_interfaceid": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Converting VIF {"id": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "address": "fa:16:3e:e0:21:ba", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d43f907-d7", "ovs_interfaceid": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:21:ba,bridge_name='br-int',has_traffic_filtering=True,id=0d43f907-d7ec-4016-bf54-c9dd4ded6cf8,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d43f907-d7') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.objects.instance [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lazy-loading 'pci_devices' on Instance uuid 102fc1ab-bee7-4f14-a9de-729b521eb8ba {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:50:21 user nova-compute[71516]:   <uuid>102fc1ab-bee7-4f14-a9de-729b521eb8ba</uuid>
Apr 11 23:50:21 user nova-compute[71516]:   <name>instance-0000002e</name>
Apr 11 23:50:21 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:50:21 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:50:21 user nova-compute[71516]:   <metadata>
Apr 11 23:50:21 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:50:21 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:50:21 user nova-compute[71516]:       <nova:name>tempest-VolumesActionsTest-instance-365157374</nova:name>
Apr 11 23:50:21 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:50:21</nova:creationTime>
Apr 11 23:50:21 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:50:21 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:50:21 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:50:21 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:50:21 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:50:21 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:50:21 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:50:21 user nova-compute[71516]:       <nova:owner>
Apr 11 23:50:21 user nova-compute[71516]:         <nova:user uuid="4660aa9abec348f5a999a753be05b3e7">tempest-VolumesActionsTest-1048592318-project-member</nova:user>
Apr 11 23:50:21 user nova-compute[71516]:         <nova:project uuid="52014401b1a74ddcb07e284fb081d5bc">tempest-VolumesActionsTest-1048592318</nova:project>
Apr 11 23:50:21 user nova-compute[71516]:       </nova:owner>
Apr 11 23:50:21 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:50:21 user nova-compute[71516]:       <nova:ports>
Apr 11 23:50:21 user nova-compute[71516]:         <nova:port uuid="0d43f907-d7ec-4016-bf54-c9dd4ded6cf8">
Apr 11 23:50:21 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 23:50:21 user nova-compute[71516]:         </nova:port>
Apr 11 23:50:21 user nova-compute[71516]:       </nova:ports>
Apr 11 23:50:21 user nova-compute[71516]:     </nova:instance>
Apr 11 23:50:21 user nova-compute[71516]:   </metadata>
Apr 11 23:50:21 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:50:21 user nova-compute[71516]:     <system>
Apr 11 23:50:21 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:50:21 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:50:21 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:50:21 user nova-compute[71516]:       <entry name="serial">102fc1ab-bee7-4f14-a9de-729b521eb8ba</entry>
Apr 11 23:50:21 user nova-compute[71516]:       <entry name="uuid">102fc1ab-bee7-4f14-a9de-729b521eb8ba</entry>
Apr 11 23:50:21 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:50:21 user nova-compute[71516]:     </system>
Apr 11 23:50:21 user nova-compute[71516]:   </sysinfo>
Apr 11 23:50:21 user nova-compute[71516]:   <os>
Apr 11 23:50:21 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:50:21 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:50:21 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:50:21 user nova-compute[71516]:   </os>
Apr 11 23:50:21 user nova-compute[71516]:   <features>
Apr 11 23:50:21 user nova-compute[71516]:     <acpi/>
Apr 11 23:50:21 user nova-compute[71516]:     <apic/>
Apr 11 23:50:21 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:50:21 user nova-compute[71516]:   </features>
Apr 11 23:50:21 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:50:21 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:50:21 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:50:21 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:50:21 user nova-compute[71516]:   </clock>
Apr 11 23:50:21 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:50:21 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:50:21 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:50:21 user nova-compute[71516]:   </cpu>
Apr 11 23:50:21 user nova-compute[71516]:   <devices>
Apr 11 23:50:21 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:50:21 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:50:21 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk"/>
Apr 11 23:50:21 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:50:21 user nova-compute[71516]:     </disk>
Apr 11 23:50:21 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:50:21 user nova-compute[71516]:       <mac address="fa:16:3e:e0:21:ba"/>
Apr 11 23:50:21 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:50:21 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:50:21 user nova-compute[71516]:       <target dev="tap0d43f907-d7"/>
Apr 11 23:50:21 user nova-compute[71516]:     </interface>
Apr 11 23:50:21 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:50:21 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/console.log" append="off"/>
Apr 11 23:50:21 user nova-compute[71516]:     </serial>
Apr 11 23:50:21 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:50:21 user nova-compute[71516]:     <video>
Apr 11 23:50:21 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:50:21 user nova-compute[71516]:     </video>
Apr 11 23:50:21 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:50:21 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:50:21 user nova-compute[71516]:     </rng>
Apr 11 23:50:21 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:50:21 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:50:21 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:50:21 user nova-compute[71516]:     </memballoon>
Apr 11 23:50:21 user nova-compute[71516]:   </devices>
Apr 11 23:50:21 user nova-compute[71516]: </domain>
Apr 11 23:50:21 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:50:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-365157374',display_name='tempest-VolumesActionsTest-instance-365157374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-365157374',id=46,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52014401b1a74ddcb07e284fb081d5bc',ramdisk_id='',reservation_id='r-am3l5tcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1048592318',owner_user_name='tempest-VolumesActionsTest-1048592318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:50:20Z,user_data=None,user_id='4660aa9abec348f5a999a753be05b3e7',uuid=102fc1ab-bee7-4f14-a9de-729b521eb8ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "address": "fa:16:3e:e0:21:ba", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d43f907-d7", "ovs_interfaceid": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Converting VIF {"id": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "address": "fa:16:3e:e0:21:ba", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d43f907-d7", "ovs_interfaceid": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:21:ba,bridge_name='br-int',has_traffic_filtering=True,id=0d43f907-d7ec-4016-bf54-c9dd4ded6cf8,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d43f907-d7') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG os_vif [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:21:ba,bridge_name='br-int',has_traffic_filtering=True,id=0d43f907-d7ec-4016-bf54-c9dd4ded6cf8,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d43f907-d7') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d43f907-d7, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d43f907-d7, col_values=(('external_ids', {'iface-id': '0d43f907-d7ec-4016-bf54-c9dd4ded6cf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:21:ba', 'vm-uuid': '102fc1ab-bee7-4f14-a9de-729b521eb8ba'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:21 user nova-compute[71516]: INFO os_vif [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:21:ba,bridge_name='br-int',has_traffic_filtering=True,id=0d43f907-d7ec-4016-bf54-c9dd4ded6cf8,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d43f907-d7')
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:50:21 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] No VIF found with MAC fa:16:3e:e0:21:ba, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:50:22 user nova-compute[71516]: DEBUG nova.network.neutron [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Updated VIF entry in instance network info cache for port 0d43f907-d7ec-4016-bf54-c9dd4ded6cf8. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:50:22 user nova-compute[71516]: DEBUG nova.network.neutron [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Updating instance_info_cache with network_info: [{"id": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "address": "fa:16:3e:e0:21:ba", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d43f907-d7", "ovs_interfaceid": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:50:22 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] Releasing lock "refresh_cache-102fc1ab-bee7-4f14-a9de-729b521eb8ba" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:50:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:23 user nova-compute[71516]: DEBUG nova.compute.manager [req-884c7a35-4a5c-413d-b76f-77cb7c452c82 req-01d7a5eb-1edc-4fce-b631-729edde2af0f service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Received event network-vif-plugged-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:50:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-884c7a35-4a5c-413d-b76f-77cb7c452c82 req-01d7a5eb-1edc-4fce-b631-729edde2af0f service nova] Acquiring lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:50:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-884c7a35-4a5c-413d-b76f-77cb7c452c82 req-01d7a5eb-1edc-4fce-b631-729edde2af0f service nova] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:50:23 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-884c7a35-4a5c-413d-b76f-77cb7c452c82 req-01d7a5eb-1edc-4fce-b631-729edde2af0f service nova] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:50:23 user nova-compute[71516]: DEBUG nova.compute.manager [req-884c7a35-4a5c-413d-b76f-77cb7c452c82 req-01d7a5eb-1edc-4fce-b631-729edde2af0f service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] No waiting events found dispatching network-vif-plugged-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:50:23 user nova-compute[71516]: WARNING nova.compute.manager [req-884c7a35-4a5c-413d-b76f-77cb7c452c82 req-01d7a5eb-1edc-4fce-b631-729edde2af0f service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Received unexpected event network-vif-plugged-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 for instance with vm_state building and task_state spawning.
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681257025.148167, 102fc1ab-bee7-4f14-a9de-729b521eb8ba => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:50:25 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] VM Resumed (Lifecycle Event)
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:50:25 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Instance spawned successfully.
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:50:25 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681257025.151105, 102fc1ab-bee7-4f14-a9de-729b521eb8ba => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:50:25 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] VM Started (Lifecycle Event)
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:50:25 user nova-compute[71516]: INFO nova.compute.manager [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Took 5.59 seconds to spawn the instance on the hypervisor.
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:50:25 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.compute.manager [req-cfdaf7ba-dfa6-4432-b368-20823d4f7b90 req-de0beac4-5f99-4d2a-83b2-e1e366330e33 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Received event network-vif-plugged-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cfdaf7ba-dfa6-4432-b368-20823d4f7b90 req-de0beac4-5f99-4d2a-83b2-e1e366330e33 service nova] Acquiring lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cfdaf7ba-dfa6-4432-b368-20823d4f7b90 req-de0beac4-5f99-4d2a-83b2-e1e366330e33 service nova] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-cfdaf7ba-dfa6-4432-b368-20823d4f7b90 req-de0beac4-5f99-4d2a-83b2-e1e366330e33 service nova] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:50:25 user nova-compute[71516]: DEBUG nova.compute.manager [req-cfdaf7ba-dfa6-4432-b368-20823d4f7b90 req-de0beac4-5f99-4d2a-83b2-e1e366330e33 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] No waiting events found dispatching network-vif-plugged-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:50:25 user nova-compute[71516]: WARNING nova.compute.manager [req-cfdaf7ba-dfa6-4432-b368-20823d4f7b90 req-de0beac4-5f99-4d2a-83b2-e1e366330e33 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Received unexpected event network-vif-plugged-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 for instance with vm_state building and task_state spawning.
Apr 11 23:50:25 user nova-compute[71516]: INFO nova.compute.manager [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Took 6.11 seconds to build instance.
Apr 11 23:50:25 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.197s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:50:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:50:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:50:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:50:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:50:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:50:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:50:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:50:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:50:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:50:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:50:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:50:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:50:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:50:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:50:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:50:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:50:56 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:51:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 23:51:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] There are 0 instances to clean {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 23:51:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:51:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:51:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:51:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:51:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:51:01 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:51:04 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:06 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:51:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:51:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:51:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:51:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:51:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:51:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:51:06 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:51:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:51:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:51:06 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:51:06 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=26.075702667236328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:51:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:51:06 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:51:07 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:51:07 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:51:07 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:51:07 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:51:07 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:51:07 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:51:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:51:11 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:11 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:11 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:51:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:51:11 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:51:12 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:13 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:51:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:51:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-102fc1ab-bee7-4f14-a9de-729b521eb8ba" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:51:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-102fc1ab-bee7-4f14-a9de-729b521eb8ba" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:51:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:51:13 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid 102fc1ab-bee7-4f14-a9de-729b521eb8ba {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:51:14 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Updating instance_info_cache with network_info: [{"id": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "address": "fa:16:3e:e0:21:ba", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d43f907-d7", "ovs_interfaceid": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:51:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-102fc1ab-bee7-4f14-a9de-729b521eb8ba" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:51:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:51:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:51:19 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:21 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:21 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:51:24 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:24 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances with incomplete migration  {{(pid=71516) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 23:51:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:51:31 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:51:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_power_states {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:51:32 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Triggering sync for uuid 102fc1ab-bee7-4f14-a9de-729b521eb8ba {{(pid=71516) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 23:51:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:51:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:51:32 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:51:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:51:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:51:41 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:51:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:51:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:51:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:51:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:01 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:52:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:52:04 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:52:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:52:08 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:52:08 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:52:08 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8851MB free_disk=26.07512664794922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:52:08 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing inventories for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating ProviderTree inventory for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Updating inventory in ProviderTree for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing aggregate associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, aggregates: None {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Refreshing trait associations for resource provider 4d8a043f-686c-4589-9f1b-5d9579db89a3, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=71516) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:52:09 user nova-compute[71516]: INFO nova.compute.manager [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Terminating instance
Apr 11 23:52:09 user nova-compute[71516]: DEBUG nova.compute.manager [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:52:09 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-d0a5fbf4-e3bd-4207-91d3-34d830029c48 req-3a28e45c-330f-4ae0-8638-65ddad9106d3 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Received event network-vif-unplugged-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d0a5fbf4-e3bd-4207-91d3-34d830029c48 req-3a28e45c-330f-4ae0-8638-65ddad9106d3 service nova] Acquiring lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d0a5fbf4-e3bd-4207-91d3-34d830029c48 req-3a28e45c-330f-4ae0-8638-65ddad9106d3 service nova] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d0a5fbf4-e3bd-4207-91d3-34d830029c48 req-3a28e45c-330f-4ae0-8638-65ddad9106d3 service nova] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-d0a5fbf4-e3bd-4207-91d3-34d830029c48 req-3a28e45c-330f-4ae0-8638-65ddad9106d3 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] No waiting events found dispatching network-vif-unplugged-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG nova.compute.manager [req-d0a5fbf4-e3bd-4207-91d3-34d830029c48 req-3a28e45c-330f-4ae0-8638-65ddad9106d3 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Received event network-vif-unplugged-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Instance destroyed successfully.
Apr 11 23:52:10 user nova-compute[71516]: DEBUG nova.objects.instance [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lazy-loading 'resources' on Instance uuid 102fc1ab-bee7-4f14-a9de-729b521eb8ba {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:50:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-365157374',display_name='tempest-VolumesActionsTest-instance-365157374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-365157374',id=46,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:50:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52014401b1a74ddcb07e284fb081d5bc',ramdisk_id='',reservation_id='r-am3l5tcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1048592318',owner_user_name='tempest-VolumesActionsTest-1048592318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:50:25Z,user_data=None,user_id='4660aa9abec348f5a999a753be05b3e7',uuid=102fc1ab-bee7-4f14-a9de-729b521eb8ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "address": "fa:16:3e:e0:21:ba", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d43f907-d7", "ovs_interfaceid": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Converting VIF {"id": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "address": "fa:16:3e:e0:21:ba", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d43f907-d7", "ovs_interfaceid": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:21:ba,bridge_name='br-int',has_traffic_filtering=True,id=0d43f907-d7ec-4016-bf54-c9dd4ded6cf8,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d43f907-d7') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG os_vif [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:21:ba,bridge_name='br-int',has_traffic_filtering=True,id=0d43f907-d7ec-4016-bf54-c9dd4ded6cf8,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d43f907-d7') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d43f907-d7, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:52:10 user nova-compute[71516]: INFO os_vif [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:21:ba,bridge_name='br-int',has_traffic_filtering=True,id=0d43f907-d7ec-4016-bf54-c9dd4ded6cf8,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d43f907-d7')
Apr 11 23:52:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Deleting instance files /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba_del
Apr 11 23:52:10 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Deletion of /opt/stack/data/nova/instances/102fc1ab-bee7-4f14-a9de-729b521eb8ba_del complete
Apr 11 23:52:10 user nova-compute[71516]: INFO nova.compute.manager [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 23:52:10 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:52:10 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:52:11 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:52:11 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:52:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:52:11 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:52:11 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Took 0.55 seconds to deallocate network for instance.
Apr 11 23:52:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:52:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:52:11 user nova-compute[71516]: DEBUG nova.compute.manager [req-d161505d-ee3f-4468-ab38-51ac670e02d9 req-cb98d644-6fbb-4d3b-bf48-7cddf8f1d406 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Received event network-vif-deleted-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:52:11 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:52:11 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:52:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:52:11 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Deleted allocations for instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba
Apr 11 23:52:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.746s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:52:12 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:52:12 user nova-compute[71516]: DEBUG nova.compute.manager [req-9f59b70f-16f5-4ea7-aab9-1fd936ab7fe5 req-7cfa0d51-7ca1-41c6-9bbd-080e79cb9b67 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Received event network-vif-plugged-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:52:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9f59b70f-16f5-4ea7-aab9-1fd936ab7fe5 req-7cfa0d51-7ca1-41c6-9bbd-080e79cb9b67 service nova] Acquiring lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:52:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9f59b70f-16f5-4ea7-aab9-1fd936ab7fe5 req-7cfa0d51-7ca1-41c6-9bbd-080e79cb9b67 service nova] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:52:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9f59b70f-16f5-4ea7-aab9-1fd936ab7fe5 req-7cfa0d51-7ca1-41c6-9bbd-080e79cb9b67 service nova] Lock "102fc1ab-bee7-4f14-a9de-729b521eb8ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:52:12 user nova-compute[71516]: DEBUG nova.compute.manager [req-9f59b70f-16f5-4ea7-aab9-1fd936ab7fe5 req-7cfa0d51-7ca1-41c6-9bbd-080e79cb9b67 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] No waiting events found dispatching network-vif-plugged-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:52:12 user nova-compute[71516]: WARNING nova.compute.manager [req-9f59b70f-16f5-4ea7-aab9-1fd936ab7fe5 req-7cfa0d51-7ca1-41c6-9bbd-080e79cb9b67 service nova] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Received unexpected event network-vif-plugged-0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 for instance with vm_state deleted and task_state None.
Apr 11 23:52:13 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:52:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:52:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:52:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:52:13 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:52:15 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:20 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:21 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:52:25 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681257130.5880241, 102fc1ab-bee7-4f14-a9de-729b521eb8ba => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:52:25 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] VM Stopped (Lifecycle Event)
Apr 11 23:52:25 user nova-compute[71516]: DEBUG nova.compute.manager [None req-bcf3220a-5a64-4480-951b-6820fd82fda9 None None] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:52:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:52:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:52:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:52:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:52:25 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:30 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:35 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:52:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:52:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:52:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:52:40 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:52:45 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:52:50 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:52:55 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:53:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:53:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:53:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:53:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:53:00 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "947314be-5091-4765-9855-5dd715371680" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "947314be-5091-4765-9855-5dd715371680" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Starting instance... {{(pid=71516) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71516) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 23:53:01 user nova-compute[71516]: INFO nova.compute.claims [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Claim successful on node user
Apr 11 23:53:01 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.188s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Start building networks asynchronously for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Allocating IP information in the background. {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] allocate_for_instance() {{(pid=71516) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 23:53:01 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 23:53:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Start building block device mappings for instance. {{(pid=71516) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG nova.policy [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4660aa9abec348f5a999a753be05b3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52014401b1a74ddcb07e284fb081d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71516) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Start spawning the instance on the hypervisor. {{(pid=71516) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Creating instance directory {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 23:53:01 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Creating image(s)
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "/opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "/opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "/opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.149s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "75a186defe322614f3ad71371bc73fc34caa51a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.142s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk 1073741824 {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4,backing_fmt=raw /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk 1073741824" returned: 0 in 0.051s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:53:01 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "75a186defe322614f3ad71371bc73fc34caa51a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:53:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:53:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a186defe322614f3ad71371bc73fc34caa51a4 --force-share --output=json" returned: 0 in 0.133s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:53:02 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk. size=1073741824 {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 23:53:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:53:02 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:53:02 user nova-compute[71516]: DEBUG nova.virt.disk.api [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Cannot resize image /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk to a smaller size. {{(pid=71516) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 23:53:02 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lazy-loading 'migration_context' on Instance uuid 947314be-5091-4765-9855-5dd715371680 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:53:02 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Created local disks {{(pid=71516) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 23:53:02 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Ensure instance console log exists: /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/console.log {{(pid=71516) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 23:53:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:53:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:53:02 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:53:02 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Successfully created port: ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Successfully updated port: ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "refresh_cache-947314be-5091-4765-9855-5dd715371680" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquired lock "refresh_cache-947314be-5091-4765-9855-5dd715371680" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Building network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received event network-changed-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.compute.manager [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Refreshing instance network info cache due to event network-changed-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382. {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] Acquiring lock "refresh_cache-947314be-5091-4765-9855-5dd715371680" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Instance cache missing network info. {{(pid=71516) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.network.neutron [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Updating instance_info_cache with network_info: [{"id": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "address": "fa:16:3e:ba:e0:97", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0a33a2-d9", "ovs_interfaceid": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Releasing lock "refresh_cache-947314be-5091-4765-9855-5dd715371680" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Instance network_info: |[{"id": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "address": "fa:16:3e:ba:e0:97", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0a33a2-d9", "ovs_interfaceid": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71516) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] Acquired lock "refresh_cache-947314be-5091-4765-9855-5dd715371680" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.network.neutron [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Refreshing network info cache for port ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Start _get_guest_xml network_info=[{"id": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "address": "fa:16:3e:ba:e0:97", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0a33a2-d9", "ovs_interfaceid": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 23:53:03 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:53:03 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71516) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T23:01:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T23:00:49Z,direct_url=<?>,disk_format='qcow2',id=1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='dc4c5175ee99459396db72418ed47d73',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T23:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Flavor limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Image limits 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Flavor pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Image pref 0:0:0 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Got 1 possible topologies {{(pid=71516) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71516) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1458020268',display_name='tempest-VolumesActionsTest-instance-1458020268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1458020268',id=47,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52014401b1a74ddcb07e284fb081d5bc',ramdisk_id='',reservation_id='r-191gfe3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1048592318',owner_user_name='tempest-VolumesActionsTest-1048592318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:53:02Z,user_data=None,user_id='4660aa9abec348f5a999a753be05b3e7',uuid=947314be-5091-4765-9855-5dd715371680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "address": "fa:16:3e:ba:e0:97", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0a33a2-d9", "ovs_interfaceid": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71516) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Converting VIF {"id": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "address": "fa:16:3e:ba:e0:97", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0a33a2-d9", "ovs_interfaceid": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e0:97,bridge_name='br-int',has_traffic_filtering=True,id=ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0a33a2-d9') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.objects.instance [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lazy-loading 'pci_devices' on Instance uuid 947314be-5091-4765-9855-5dd715371680 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] End _get_guest_xml xml=<domain type="kvm">
Apr 11 23:53:03 user nova-compute[71516]:   <uuid>947314be-5091-4765-9855-5dd715371680</uuid>
Apr 11 23:53:03 user nova-compute[71516]:   <name>instance-0000002f</name>
Apr 11 23:53:03 user nova-compute[71516]:   <memory>131072</memory>
Apr 11 23:53:03 user nova-compute[71516]:   <vcpu>1</vcpu>
Apr 11 23:53:03 user nova-compute[71516]:   <metadata>
Apr 11 23:53:03 user nova-compute[71516]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 23:53:03 user nova-compute[71516]:       <nova:package version="0.0.0"/>
Apr 11 23:53:03 user nova-compute[71516]:       <nova:name>tempest-VolumesActionsTest-instance-1458020268</nova:name>
Apr 11 23:53:03 user nova-compute[71516]:       <nova:creationTime>2023-04-11 23:53:03</nova:creationTime>
Apr 11 23:53:03 user nova-compute[71516]:       <nova:flavor name="m1.nano">
Apr 11 23:53:03 user nova-compute[71516]:         <nova:memory>128</nova:memory>
Apr 11 23:53:03 user nova-compute[71516]:         <nova:disk>1</nova:disk>
Apr 11 23:53:03 user nova-compute[71516]:         <nova:swap>0</nova:swap>
Apr 11 23:53:03 user nova-compute[71516]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 23:53:03 user nova-compute[71516]:         <nova:vcpus>1</nova:vcpus>
Apr 11 23:53:03 user nova-compute[71516]:       </nova:flavor>
Apr 11 23:53:03 user nova-compute[71516]:       <nova:owner>
Apr 11 23:53:03 user nova-compute[71516]:         <nova:user uuid="4660aa9abec348f5a999a753be05b3e7">tempest-VolumesActionsTest-1048592318-project-member</nova:user>
Apr 11 23:53:03 user nova-compute[71516]:         <nova:project uuid="52014401b1a74ddcb07e284fb081d5bc">tempest-VolumesActionsTest-1048592318</nova:project>
Apr 11 23:53:03 user nova-compute[71516]:       </nova:owner>
Apr 11 23:53:03 user nova-compute[71516]:       <nova:root type="image" uuid="1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a"/>
Apr 11 23:53:03 user nova-compute[71516]:       <nova:ports>
Apr 11 23:53:03 user nova-compute[71516]:         <nova:port uuid="ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382">
Apr 11 23:53:03 user nova-compute[71516]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 23:53:03 user nova-compute[71516]:         </nova:port>
Apr 11 23:53:03 user nova-compute[71516]:       </nova:ports>
Apr 11 23:53:03 user nova-compute[71516]:     </nova:instance>
Apr 11 23:53:03 user nova-compute[71516]:   </metadata>
Apr 11 23:53:03 user nova-compute[71516]:   <sysinfo type="smbios">
Apr 11 23:53:03 user nova-compute[71516]:     <system>
Apr 11 23:53:03 user nova-compute[71516]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 23:53:03 user nova-compute[71516]:       <entry name="product">OpenStack Nova</entry>
Apr 11 23:53:03 user nova-compute[71516]:       <entry name="version">0.0.0</entry>
Apr 11 23:53:03 user nova-compute[71516]:       <entry name="serial">947314be-5091-4765-9855-5dd715371680</entry>
Apr 11 23:53:03 user nova-compute[71516]:       <entry name="uuid">947314be-5091-4765-9855-5dd715371680</entry>
Apr 11 23:53:03 user nova-compute[71516]:       <entry name="family">Virtual Machine</entry>
Apr 11 23:53:03 user nova-compute[71516]:     </system>
Apr 11 23:53:03 user nova-compute[71516]:   </sysinfo>
Apr 11 23:53:03 user nova-compute[71516]:   <os>
Apr 11 23:53:03 user nova-compute[71516]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 23:53:03 user nova-compute[71516]:     <boot dev="hd"/>
Apr 11 23:53:03 user nova-compute[71516]:     <smbios mode="sysinfo"/>
Apr 11 23:53:03 user nova-compute[71516]:   </os>
Apr 11 23:53:03 user nova-compute[71516]:   <features>
Apr 11 23:53:03 user nova-compute[71516]:     <acpi/>
Apr 11 23:53:03 user nova-compute[71516]:     <apic/>
Apr 11 23:53:03 user nova-compute[71516]:     <vmcoreinfo/>
Apr 11 23:53:03 user nova-compute[71516]:   </features>
Apr 11 23:53:03 user nova-compute[71516]:   <clock offset="utc">
Apr 11 23:53:03 user nova-compute[71516]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 23:53:03 user nova-compute[71516]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 23:53:03 user nova-compute[71516]:     <timer name="hpet" present="no"/>
Apr 11 23:53:03 user nova-compute[71516]:   </clock>
Apr 11 23:53:03 user nova-compute[71516]:   <cpu mode="custom" match="exact">
Apr 11 23:53:03 user nova-compute[71516]:     <model>Nehalem</model>
Apr 11 23:53:03 user nova-compute[71516]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 23:53:03 user nova-compute[71516]:   </cpu>
Apr 11 23:53:03 user nova-compute[71516]:   <devices>
Apr 11 23:53:03 user nova-compute[71516]:     <disk type="file" device="disk">
Apr 11 23:53:03 user nova-compute[71516]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 23:53:03 user nova-compute[71516]:       <source file="/opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk"/>
Apr 11 23:53:03 user nova-compute[71516]:       <target dev="vda" bus="virtio"/>
Apr 11 23:53:03 user nova-compute[71516]:     </disk>
Apr 11 23:53:03 user nova-compute[71516]:     <interface type="ethernet">
Apr 11 23:53:03 user nova-compute[71516]:       <mac address="fa:16:3e:ba:e0:97"/>
Apr 11 23:53:03 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:53:03 user nova-compute[71516]:       <mtu size="1442"/>
Apr 11 23:53:03 user nova-compute[71516]:       <target dev="tapae0a33a2-d9"/>
Apr 11 23:53:03 user nova-compute[71516]:     </interface>
Apr 11 23:53:03 user nova-compute[71516]:     <serial type="pty">
Apr 11 23:53:03 user nova-compute[71516]:       <log file="/opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/console.log" append="off"/>
Apr 11 23:53:03 user nova-compute[71516]:     </serial>
Apr 11 23:53:03 user nova-compute[71516]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 23:53:03 user nova-compute[71516]:     <video>
Apr 11 23:53:03 user nova-compute[71516]:       <model type="virtio"/>
Apr 11 23:53:03 user nova-compute[71516]:     </video>
Apr 11 23:53:03 user nova-compute[71516]:     <rng model="virtio">
Apr 11 23:53:03 user nova-compute[71516]:       <backend model="random">/dev/urandom</backend>
Apr 11 23:53:03 user nova-compute[71516]:     </rng>
Apr 11 23:53:03 user nova-compute[71516]:     <controller type="usb" index="0" model="none"/>
Apr 11 23:53:03 user nova-compute[71516]:     <memballoon model="virtio">
Apr 11 23:53:03 user nova-compute[71516]:       <stats period="10"/>
Apr 11 23:53:03 user nova-compute[71516]:     </memballoon>
Apr 11 23:53:03 user nova-compute[71516]:   </devices>
Apr 11 23:53:03 user nova-compute[71516]: </domain>
Apr 11 23:53:03 user nova-compute[71516]:  {{(pid=71516) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1458020268',display_name='tempest-VolumesActionsTest-instance-1458020268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1458020268',id=47,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52014401b1a74ddcb07e284fb081d5bc',ramdisk_id='',reservation_id='r-191gfe3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1048592318',owner_user_name='tempest-VolumesActionsTest-1048592318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T23:53:02Z,user_data=None,user_id='4660aa9abec348f5a999a753be05b3e7',uuid=947314be-5091-4765-9855-5dd715371680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "address": "fa:16:3e:ba:e0:97", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0a33a2-d9", "ovs_interfaceid": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Converting VIF {"id": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "address": "fa:16:3e:ba:e0:97", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0a33a2-d9", "ovs_interfaceid": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e0:97,bridge_name='br-int',has_traffic_filtering=True,id=ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0a33a2-d9') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG os_vif [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e0:97,bridge_name='br-int',has_traffic_filtering=True,id=ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0a33a2-d9') {{(pid=71516) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae0a33a2-d9, may_exist=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae0a33a2-d9, col_values=(('external_ids', {'iface-id': 'ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:e0:97', 'vm-uuid': '947314be-5091-4765-9855-5dd715371680'}),)) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:03 user nova-compute[71516]: INFO os_vif [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e0:97,bridge_name='br-int',has_traffic_filtering=True,id=ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0a33a2-d9')
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] No BDM found with device name vda, not building metadata. {{(pid=71516) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] No VIF found with MAC fa:16:3e:ba:e0:97, not building metadata {{(pid=71516) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.network.neutron [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Updated VIF entry in instance network info cache for port ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382. {{(pid=71516) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG nova.network.neutron [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Updating instance_info_cache with network_info: [{"id": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "address": "fa:16:3e:ba:e0:97", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0a33a2-d9", "ovs_interfaceid": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:53:03 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] Releasing lock "refresh_cache-947314be-5091-4765-9855-5dd715371680" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:53:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:04 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-44cc6980-473d-4b5d-89d4-6017b812c299 req-23223700-9003-4559-b32f-f75daf888719 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received event network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:53:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-44cc6980-473d-4b5d-89d4-6017b812c299 req-23223700-9003-4559-b32f-f75daf888719 service nova] Acquiring lock "947314be-5091-4765-9855-5dd715371680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:53:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-44cc6980-473d-4b5d-89d4-6017b812c299 req-23223700-9003-4559-b32f-f75daf888719 service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:53:05 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-44cc6980-473d-4b5d-89d4-6017b812c299 req-23223700-9003-4559-b32f-f75daf888719 service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:53:05 user nova-compute[71516]: DEBUG nova.compute.manager [req-44cc6980-473d-4b5d-89d4-6017b812c299 req-23223700-9003-4559-b32f-f75daf888719 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] No waiting events found dispatching network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:53:05 user nova-compute[71516]: WARNING nova.compute.manager [req-44cc6980-473d-4b5d-89d4-6017b812c299 req-23223700-9003-4559-b32f-f75daf888719 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received unexpected event network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance with vm_state building and task_state spawning.
Apr 11 23:53:06 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:53:06 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681257187.0097444, 947314be-5091-4765-9855-5dd715371680 => Resumed> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:53:07 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 947314be-5091-4765-9855-5dd715371680] VM Resumed (Lifecycle Event)
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Instance event wait completed in 0 seconds for  {{(pid=71516) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Guest created on hypervisor {{(pid=71516) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 23:53:07 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 947314be-5091-4765-9855-5dd715371680] Instance spawned successfully.
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 947314be-5091-4765-9855-5dd715371680] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 947314be-5091-4765-9855-5dd715371680] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Found default for hw_cdrom_bus of ide {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Found default for hw_disk_bus of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Found default for hw_input_bus of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Found default for hw_pointer_model of None {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Found default for hw_video_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.virt.libvirt.driver [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Found default for hw_vif_model of virtio {{(pid=71516) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 23:53:07 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 947314be-5091-4765-9855-5dd715371680] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.virt.driver [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] Emitting event <LifecycleEvent: 1681257187.011881, 947314be-5091-4765-9855-5dd715371680 => Started> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:53:07 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 947314be-5091-4765-9855-5dd715371680] VM Started (Lifecycle Event)
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 947314be-5091-4765-9855-5dd715371680] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 947314be-5091-4765-9855-5dd715371680] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71516) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 23:53:07 user nova-compute[71516]: INFO nova.compute.manager [None req-52fded78-51e5-4251-93a3-59df9ed8a6b8 None None] [instance: 947314be-5091-4765-9855-5dd715371680] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 23:53:07 user nova-compute[71516]: INFO nova.compute.manager [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Took 5.50 seconds to spawn the instance on the hypervisor.
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-c92bc9c2-766f-48b2-842c-45d618690566 req-21e16031-5d19-4085-b9c2-9e5f8aec36f9 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received event network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c92bc9c2-766f-48b2-842c-45d618690566 req-21e16031-5d19-4085-b9c2-9e5f8aec36f9 service nova] Acquiring lock "947314be-5091-4765-9855-5dd715371680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c92bc9c2-766f-48b2-842c-45d618690566 req-21e16031-5d19-4085-b9c2-9e5f8aec36f9 service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-c92bc9c2-766f-48b2-842c-45d618690566 req-21e16031-5d19-4085-b9c2-9e5f8aec36f9 service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:53:07 user nova-compute[71516]: DEBUG nova.compute.manager [req-c92bc9c2-766f-48b2-842c-45d618690566 req-21e16031-5d19-4085-b9c2-9e5f8aec36f9 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] No waiting events found dispatching network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:53:07 user nova-compute[71516]: WARNING nova.compute.manager [req-c92bc9c2-766f-48b2-842c-45d618690566 req-21e16031-5d19-4085-b9c2-9e5f8aec36f9 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received unexpected event network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance with vm_state building and task_state spawning.
Apr 11 23:53:07 user nova-compute[71516]: INFO nova.compute.manager [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Took 5.98 seconds to build instance.
Apr 11 23:53:07 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "947314be-5091-4765-9855-5dd715371680" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.079s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:53:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:10 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:53:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:53:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:53:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:53:10 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:53:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:53:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:53:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:53:10 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:53:10 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:53:10 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:53:10 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=26.091796875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:53:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:53:10 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:53:11 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 947314be-5091-4765-9855-5dd715371680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:53:11 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:53:11 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:53:11 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:53:11 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:53:11 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:53:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:53:12 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:53:12 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:53:12 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:53:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:53:13 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:53:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:53:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:53:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-947314be-5091-4765-9855-5dd715371680" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:53:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-947314be-5091-4765-9855-5dd715371680" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:53:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 947314be-5091-4765-9855-5dd715371680] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:53:13 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid 947314be-5091-4765-9855-5dd715371680 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:53:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:53:13 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 947314be-5091-4765-9855-5dd715371680] Updating instance_info_cache with network_info: [{"id": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "address": "fa:16:3e:ba:e0:97", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0a33a2-d9", "ovs_interfaceid": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:53:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-947314be-5091-4765-9855-5dd715371680" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:53:13 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 947314be-5091-4765-9855-5dd715371680] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:53:13 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:53:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:53:20 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:53:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:23 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:53:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:26 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:53:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:53:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:53:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:53:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:36 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:53:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:53:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:53:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:53:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:46 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:53:53 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:53:58 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:54:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:54:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:54:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:54:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:54:03 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:54:04 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:54:07 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:54:08 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:11 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:54:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:54:11 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:54:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:54:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:54:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:54:11 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:54:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:54:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:54:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk --force-share --output=json {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 23:54:11 user nova-compute[71516]: DEBUG oslo_concurrency.processutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71516) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 23:54:11 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:54:11 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:54:11 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=26.072860717773438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:54:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:54:11 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:54:12 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Instance 947314be-5091-4765-9855-5dd715371680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71516) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 23:54:12 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:54:12 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:54:12 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:54:12 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:54:12 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:54:12 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:54:13 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:54:13 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:54:13 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:54:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:54:14 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:54:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:54:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:54:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "refresh_cache-947314be-5091-4765-9855-5dd715371680" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 23:54:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquired lock "refresh_cache-947314be-5091-4765-9855-5dd715371680" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 23:54:14 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 947314be-5091-4765-9855-5dd715371680] Forcefully refreshing network info cache for instance {{(pid=71516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 23:54:14 user nova-compute[71516]: DEBUG nova.objects.instance [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lazy-loading 'info_cache' on Instance uuid 947314be-5091-4765-9855-5dd715371680 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:54:14 user nova-compute[71516]: DEBUG nova.network.neutron [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 947314be-5091-4765-9855-5dd715371680] Updating instance_info_cache with network_info: [{"id": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "address": "fa:16:3e:ba:e0:97", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0a33a2-d9", "ovs_interfaceid": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:54:14 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Releasing lock "refresh_cache-947314be-5091-4765-9855-5dd715371680" {{(pid=71516) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 23:54:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] [instance: 947314be-5091-4765-9855-5dd715371680] Updated the network info_cache for instance {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 23:54:16 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:18 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:21 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:23 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:54:23 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:28 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:33 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:38 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:54:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:54:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:54:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:54:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:54:43 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:48 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:54:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "947314be-5091-4765-9855-5dd715371680" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:54:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "947314be-5091-4765-9855-5dd715371680" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:54:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "947314be-5091-4765-9855-5dd715371680-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:54:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "947314be-5091-4765-9855-5dd715371680-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:54:51 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "947314be-5091-4765-9855-5dd715371680-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:54:51 user nova-compute[71516]: INFO nova.compute.manager [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Terminating instance
Apr 11 23:54:51 user nova-compute[71516]: DEBUG nova.compute.manager [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Start destroying the instance on the hypervisor. {{(pid=71516) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 23:54:51 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-9c0c37f2-5ccf-4aea-b6b2-ecf1bb9dfbd1 req-1c47151f-442a-4764-9b3b-c5367e724988 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received event network-vif-unplugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9c0c37f2-5ccf-4aea-b6b2-ecf1bb9dfbd1 req-1c47151f-442a-4764-9b3b-c5367e724988 service nova] Acquiring lock "947314be-5091-4765-9855-5dd715371680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9c0c37f2-5ccf-4aea-b6b2-ecf1bb9dfbd1 req-1c47151f-442a-4764-9b3b-c5367e724988 service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-9c0c37f2-5ccf-4aea-b6b2-ecf1bb9dfbd1 req-1c47151f-442a-4764-9b3b-c5367e724988 service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-9c0c37f2-5ccf-4aea-b6b2-ecf1bb9dfbd1 req-1c47151f-442a-4764-9b3b-c5367e724988 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] No waiting events found dispatching network-vif-unplugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG nova.compute.manager [req-9c0c37f2-5ccf-4aea-b6b2-ecf1bb9dfbd1 req-1c47151f-442a-4764-9b3b-c5367e724988 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received event network-vif-unplugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance with task_state deleting. {{(pid=71516) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:52 user nova-compute[71516]: INFO nova.virt.libvirt.driver [-] [instance: 947314be-5091-4765-9855-5dd715371680] Instance destroyed successfully.
Apr 11 23:54:52 user nova-compute[71516]: DEBUG nova.objects.instance [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lazy-loading 'resources' on Instance uuid 947314be-5091-4765-9855-5dd715371680 {{(pid=71516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG nova.virt.libvirt.vif [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T23:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1458020268',display_name='tempest-VolumesActionsTest-instance-1458020268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1458020268',id=47,image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T23:53:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52014401b1a74ddcb07e284fb081d5bc',ramdisk_id='',reservation_id='r-191gfe3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1048592318',owner_user_name='tempest-VolumesActionsTest-1048592318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T23:53:07Z,user_data=None,user_id='4660aa9abec348f5a999a753be05b3e7',uuid=947314be-5091-4765-9855-5dd715371680,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "address": "fa:16:3e:ba:e0:97", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0a33a2-d9", "ovs_interfaceid": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Converting VIF {"id": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "address": "fa:16:3e:ba:e0:97", "network": {"id": "80dd1095-f55e-41b1-bf6b-6c453525f0b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-573445400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "52014401b1a74ddcb07e284fb081d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0a33a2-d9", "ovs_interfaceid": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG nova.network.os_vif_util [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:e0:97,bridge_name='br-int',has_traffic_filtering=True,id=ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0a33a2-d9') {{(pid=71516) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG os_vif [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:e0:97,bridge_name='br-int',has_traffic_filtering=True,id=ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0a33a2-d9') {{(pid=71516) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae0a33a2-d9, bridge=br-int, if_exists=True) {{(pid=71516) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:54:52 user nova-compute[71516]: INFO os_vif [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:e0:97,bridge_name='br-int',has_traffic_filtering=True,id=ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382,network=Network(80dd1095-f55e-41b1-bf6b-6c453525f0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0a33a2-d9')
Apr 11 23:54:52 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Deleting instance files /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680_del
Apr 11 23:54:52 user nova-compute[71516]: INFO nova.virt.libvirt.driver [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Deletion of /opt/stack/data/nova/instances/947314be-5091-4765-9855-5dd715371680_del complete
Apr 11 23:54:52 user nova-compute[71516]: INFO nova.compute.manager [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 11 23:54:52 user nova-compute[71516]: DEBUG oslo.service.loopingcall [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71516) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG nova.compute.manager [-] [instance: 947314be-5091-4765-9855-5dd715371680] Deallocating network for instance {{(pid=71516) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 947314be-5091-4765-9855-5dd715371680] deallocate_for_instance() {{(pid=71516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 23:54:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:54:53 user nova-compute[71516]: DEBUG nova.network.neutron [-] [instance: 947314be-5091-4765-9855-5dd715371680] Updating instance_info_cache with network_info: [] {{(pid=71516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 23:54:53 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 947314be-5091-4765-9855-5dd715371680] Took 0.60 seconds to deallocate network for instance.
Apr 11 23:54:53 user nova-compute[71516]: DEBUG nova.compute.manager [req-b7552f23-ebb6-4d9a-a5fc-0054ae1596d5 req-f3f09732-4fbc-40ad-8d13-8f07cdd2ea29 service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received event network-vif-deleted-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:54:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:54:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:54:53 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:54:53 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:54:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:54:53 user nova-compute[71516]: INFO nova.scheduler.client.report [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Deleted allocations for instance 947314be-5091-4765-9855-5dd715371680
Apr 11 23:54:53 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "947314be-5091-4765-9855-5dd715371680" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.546s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received event network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Acquiring lock "947314be-5091-4765-9855-5dd715371680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] [instance: 947314be-5091-4765-9855-5dd715371680] No waiting events found dispatching network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:54:54 user nova-compute[71516]: WARNING nova.compute.manager [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received unexpected event network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance with vm_state deleted and task_state None.
Apr 11 23:54:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received event network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Acquiring lock "947314be-5091-4765-9855-5dd715371680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] [instance: 947314be-5091-4765-9855-5dd715371680] No waiting events found dispatching network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:54:54 user nova-compute[71516]: WARNING nova.compute.manager [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received unexpected event network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance with vm_state deleted and task_state None.
Apr 11 23:54:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received event network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Acquiring lock "947314be-5091-4765-9855-5dd715371680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] [instance: 947314be-5091-4765-9855-5dd715371680] No waiting events found dispatching network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:54:54 user nova-compute[71516]: WARNING nova.compute.manager [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received unexpected event network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance with vm_state deleted and task_state None.
Apr 11 23:54:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received event network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Acquiring lock "947314be-5091-4765-9855-5dd715371680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Lock "947314be-5091-4765-9855-5dd715371680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:54:54 user nova-compute[71516]: DEBUG nova.compute.manager [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] [instance: 947314be-5091-4765-9855-5dd715371680] No waiting events found dispatching network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 {{(pid=71516) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 23:54:54 user nova-compute[71516]: WARNING nova.compute.manager [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] [instance: 947314be-5091-4765-9855-5dd715371680] Received unexpected event network-vif-plugged-ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance with vm_state deleted and task_state None.
Apr 11 23:54:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:55:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:55:04 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:55:07 user nova-compute[71516]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681257292.4665482, 947314be-5091-4765-9855-5dd715371680 => Stopped> {{(pid=71516) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 23:55:07 user nova-compute[71516]: INFO nova.compute.manager [-] [instance: 947314be-5091-4765-9855-5dd715371680] VM Stopped (Lifecycle Event)
Apr 11 23:55:07 user nova-compute[71516]: DEBUG nova.compute.manager [None req-e35bef84-1e18-4fb2-9812-57eb53e392bd None None] [instance: 947314be-5091-4765-9855-5dd715371680] Checking state {{(pid=71516) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 23:55:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:55:08 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:55:12 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:55:12 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:55:12 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:55:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:55:13 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:55:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:55:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:55:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:55:13 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:55:13 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:55:13 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:55:13 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8941MB free_disk=26.090560913085938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:55:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:55:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:55:13 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:55:13 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:55:13 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:55:13 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:55:13 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:55:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:55:14 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:55:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:55:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:55:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:55:14 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:55:15 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:55:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:55:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:55:23 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:55:25 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:55:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:55:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:55:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:55:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:55:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:55:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:55:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:06 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:56:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:56:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:56:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:56:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:56:07 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:09 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:56:11 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:56:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 23:56:11 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] There are 0 instances to clean {{(pid=71516) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 23:56:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:56:12 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager.update_available_resource {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Auditing locally available compute resources for user (node: user) {{(pid=71516) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:13 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:56:13 user nova-compute[71516]: WARNING nova.virt.libvirt.driver [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 23:56:13 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=26.089420318603516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71516) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71516) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG nova.compute.provider_tree [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed in ProviderTree for provider: 4d8a043f-686c-4589-9f1b-5d9579db89a3 {{(pid=71516) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG nova.scheduler.client.report [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Inventory has not changed for provider 4d8a043f-686c-4589-9f1b-5d9579db89a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71516) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG nova.compute.resource_tracker [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Compute_service record updated for user:user {{(pid=71516) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 23:56:13 user nova-compute[71516]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=71516) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 23:56:14 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:56:14 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:56:14 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:56:14 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71516) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 23:56:15 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:56:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Starting heal instance info cache {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 23:56:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Rebuilding the list of instances to heal {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 23:56:15 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Didn't find any instances for network info cache update. {{(pid=71516) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 23:56:17 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:56:17 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:22 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:25 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:56:27 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:56:27 user nova-compute[71516]: DEBUG nova.compute.manager [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Cleaning up deleted instances with incomplete migration  {{(pid=71516) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 23:56:27 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:32 user nova-compute[71516]: DEBUG oslo_service.periodic_task [None req-6bd8b9dd-3528-45f8-b1c4-7f900587aeda None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71516) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 23:56:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:56:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:56:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:56:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:56:32 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:37 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:42 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:47 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:52 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:56:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:56:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:56:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:56:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:56:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:56:57 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:57:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 23:57:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 23:57:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71516) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 23:57:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:57:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71516) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 23:57:02 user nova-compute[71516]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71516) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}